Rethinking attention with performers K Choromanski, V Likhosherstov, D Dohan, X Song, A Gane, T Sarlos, ... arXiv preprint arXiv:2009.14794, 2020 | 1679 | 2020 |
Masked language modeling for proteins via linearly scalable long-context transformers K Choromanski, V Likhosherstov, D Dohan, X Song, A Gane, T Sarlos, ... arXiv preprint arXiv:2006.03555, 2020 | 97 | 2020 |
Polyvit: Co-training vision transformers on images, videos and audio V Likhosherstov, A Arnab, K Choromanski, M Lucic, Y Tay, A Weller, ... arXiv preprint arXiv:2111.12993, 2021 | 65 | 2021 |
Rethinking attention with Performers. arXiv 2020 K Choromanski, V Likhosherstov, D Dohan, X Song, A Gane, T Sarlos, ... arXiv preprint arXiv:2009.14794, 0 | 39 | |
Rethinking attention with performers. arXiv K Choromanski, V Likhosherstov, D Dohan, X Song, A Gane, T Sarlos, ... preprint, 2020 | 37 | 2020 |
Ode to an ODE KM Choromanski, JQ Davis, V Likhosherstov, X Song, JJ Slotine, J Varley, ... Advances in Neural Information Processing Systems 33, 3338-3350, 2020 | 30 | 2020 |
From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers K Choromanski, H Lin, H Chen, T Zhang, A Sehanobish, V Likhosherstov, ... International Conference on Machine Learning, 3962-3983, 2022 | 29 | 2022 |
On the expressive power of self-attention matrices V Likhosherstov, K Choromanski, A Weller arXiv preprint arXiv:2106.03764, 2021 | 29 | 2021 |
Hybrid random features K Choromanski, H Chen, H Lin, Y Ma, A Sehanobish, D Jain, MS Ryoo, ... arXiv preprint arXiv:2110.04367, 2021 | 24 | 2021 |
Sub-linear memory: How to make performers slim V Likhosherstov, KM Choromanski, JQ Davis, X Song, A Weller Advances in Neural Information Processing Systems 34, 6707-6719, 2021 | 20 | 2021 |
Chefs' random tables: Non-trigonometric random features V Likhosherstov, KM Choromanski, KA Dubey, F Liu, T Sarlos, A Weller Advances in Neural Information Processing Systems 35, 34559-34573, 2022 | 16 | 2022 |
Large‐scale log analysis of digital reading P Braslavski, V Likhosherstov, V Petras, M Gäde Proceedings of the Association for Information Science and Technology 53 (1 …, 2016 | 14 | 2016 |
Simplex random features I Reid, KM Choromanski, V Likhosherstov, A Weller International Conference on Machine Learning, 28864-28888, 2023 | 10 | 2023 |
Adaptive computation with elastic input sequence F Xue, V Likhosherstov, A Arnab, N Houlsby, M Dehghani, Y You International Conference on Machine Learning, 38971-38988, 2023 | 10 | 2023 |
Stochastic flows and geometric optimization on the orthogonal group K Choromanski, D Cheikhi, J Davis, V Likhosherstov, A Nazaret, ... International Conference on Machine Learning, 1918-1928, 2020 | 8 | 2020 |
Learning a fourier transform for linear relative positional encodings in transformers K Choromanski, S Li, V Likhosherstov, KA Dubey, S Luo, D He, Y Yang, ... International Conference on Artificial Intelligence and Statistics, 2278-2286, 2024 | 6 | 2024 |
Polyvit: Co-training vision transformers on images, videos and audio V Likhosherstov, A Arnab, KM Choromanski, M Lucic, Y Tay, M Dehghani Transactions on Machine Learning Research, 2022 | 6 | 2022 |
UFO-BLO: Unbiased first-order bilevel optimization V Likhosherstov, X Song, K Choromanski, J Davis, A Weller arXiv preprint arXiv:2006.03631, 2020 | 6 | 2020 |
Inference and Sampling of -free Ising Models V Likhosherstov, Y Maximov, M Chertkov International Conference on Machine Learning, 3963-3972, 2019 | 5 | 2019 |
Ten months of digital reading: An exploratory log study P Braslavski, V Petras, V Likhosherstov, M Gäde Research and Advanced Technology for Digital Libraries: 20th International …, 2016 | 5 | 2016 |