The attention R package, describing how to implement from scratch the attention mechanism - which forms the basis of transformers - in the R language is now ...
EDIT 2022-06-24: this code is now available (with helper functions) in the R package attention, which is on CRAN. You can install it simply using:
install.pa...