Joshua Ainslie
Joshua Ainslie
Verified email at google.com
Title
Cited by
Cited by
Year
Big Bird: Transformers for Longer Sequences.
M Zaheer, G Guruganesh, KA Dubey, J Ainslie, C Alberti, S Ontanon, ...
NeurIPS, 2020
2252020
ETC: Encoding long and structured inputs in transformers
J Ainslie, S Ontanon, C Alberti, V Cvicek, Z Fisher, P Pham, A Ravula, ...
arXiv preprint arXiv:2004.08483, 2020
402020
FNet: Mixing Tokens with Fourier Transforms
J Lee-Thorp, J Ainslie, I Eckstein, S Ontanon
arXiv preprint arXiv:2105.03824, 2021
242021
Encoding long and structured data in transformers
J Ainslie, S Ontanon, C Alberti, P Pham, A Ravula, S Sanghai
arXiv preprint arXiv:2004.08483 2, 2020
172020
Realformer: Transformer likes residual attention
R He, A Ravula, B Kanagal, J Ainslie
arXiv preprint arXiv:2012.11747, 2020
82020
Big bird: Transformers for longer sequences. arxiv e-prints, art
M Zaheer, G Guruganesh, A Dubey, J Ainslie, C Alberti, S Ontanon, ...
arXiv preprint arXiv:2007.14062, 2020
62020
ETC: encoding long and structured data in transformers
J Ainslie, S Ontañón, C Alberti, P Pham, A Ravula, S Sanghai
arXiv e-prints, arXiv: 2004.08483, 2020
52020
Making transformers solve compositional tasks
S Ontanón, J Ainslie, V Cvicek, Z Fisher
arXiv preprint arXiv:2108.04378, 2021
32021
Improving Compositional Generalization in Classification Tasks via Structure Annotations
J Kim, P Ravikumar, J Ainslie, S Ontañón
arXiv preprint arXiv:2106.10434, 2021
22021
ETC: Encoding long and structured inputs in transformers
A Ravula, C Alberti, J Ainslie, L Yang, PM Pham, Q Wang, S Ontanon, ...
22020
ReadTwice: Reading Very Large Documents with Memories
Y Zemlyanskiy, J Ainslie, M de Jong, P Pham, I Eckstein, F Sha
arXiv preprint arXiv:2105.04241, 2021
12021
Iterative Decoding for Compositional Generalization in Transformers
L Ruiz, J Ainslie, S Ontañón
arXiv preprint arXiv:2110.04169, 2021
2021
ShopTalk: A System for Conversational Faceted Search
G Manku, J Lee-Thorp, B Kanagal, J Ainslie, J Feng, Z Pearson, E Anjorin, ...
arXiv preprint arXiv:2109.00702, 2021
2021
Big Bird: Transformers for Longer Sequences Download PDF
M Zaheer, G Guruganesh, A Dubey, J Ainslie, C Alberti, S Ontanon, ...
The system can't perform the operation now. Try again later.
Articles 1–14