Hello,
Do we have a transformer implemented in OCaml somewhere?
I guess it would use tensorflow or torch bindings.
Citation:
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., … & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30.
Paper:
Implementing one from scratch is pretty challenging unless you have a Ph.D in modern machine learning.
Regards,
Francois.