NLP RG Thu-9-Dec at 15:00: Transformers are RNNs (hosted)

On Thursday RG will be hosted by Kokos and we are reading the paper from ICML-2020:

Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Angelos Katharopoulos, Apoorv Vyas, Nikolaos Pappas, François Fleuret
http://proceedings.mlr.press/v119/katharopoulos20a.html