Publications
2024
2023
- Hungry Hungry Hippos: Towards Language Modeling with State Space ModelsIn The International Conference on Learning Representations (ICLR) , 2023
2022
- Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network ModelsIn International Conference on Learning Representations (ICLR) , 2022
- Efficiently Modeling Long Sequences with Structured State SpacesIn The International Conference on Learning Representations (ICLR) , 2022
- S4ND: Modeling Images and Videos as Multidimensional Signals with State SpacesIn Advances in Neural Information Processing Systems , 2022
2021
- Scatterbrain: Unifying Sparse and Low-rank AttentionIn Advances in Neural Information Processing Systems (NeurIPS) , 2021
- Combining Recurrent, Convolutional, and Continuous-time Models with Linear State Space LayersAdvances in Neural Information Processing Systems, 2021
- Rethinking Neural Operations for Diverse TasksIn Advances in Neural Information Processing Systems , 2021
2020
- HiPPO: Recurrent Memory with Optimal Polynomial ProjectionsIn Advances in neural information processing systems (NeurIPS) , 2020
- Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear MapsIn International Conference on Learning Representations (ICLR) , 2020
2019
- Learning Fast Algorithms for Linear Transforms Using Butterfly FactorizationsIn International Conference on Machine Learning (ICML) , 2019