Summary of Inattention: Linear Context Scaling For Transformers, by Joseph Eisner
InAttention: Linear Context Scaling for Transformersby Joseph EisnerFirst submitted to arxiv on: 9 Oct 2024CategoriesMain:…
Summary of Stuffed Mamba: State Collapse and State Capacity Of Rnn-based Long-context Modeling, by Yingfa Chen et al.
Stuffed Mamba: State Collapse and State Capacity of RNN-Based Long-Context Modelingby Yingfa Chen, Xinrong Zhang,…
Summary of Joint Fine-tuning and Conversion Of Pretrained Speech and Language Models Towards Linear Complexity, by Mutian He et al.
Joint Fine-tuning and Conversion of Pretrained Speech and Language Models towards Linear Complexityby Mutian He,…
Summary of Matmamba: a Matryoshka State Space Model, by Abhinav Shukla et al.
MatMamba: A Matryoshka State Space Modelby Abhinav Shukla, Sai Vemprala, Aditya Kusupati, Ashish KapoorFirst submitted…
Summary of Defending Membership Inference Attacks Via Privacy-aware Sparsity Tuning, by Qiang Hu et al.
Defending Membership Inference Attacks via Privacy-aware Sparsity Tuningby Qiang Hu, Hengxiang Zhang, Hongxin WeiFirst submitted…
Summary of Instantir: Blind Image Restoration with Instant Generative Reference, by Jen-yuan Huang et al.
InstantIR: Blind Image Restoration with Instant Generative Referenceby Jen-Yuan Huang, Haofan Wang, Qixun Wang, Xu…
Summary of Conformal Prediction: a Data Perspective, by Xiaofan Zhou et al.
Conformal Prediction: A Data Perspectiveby Xiaofan Zhou, Baiting Chen, Yu Gui, Lu ChengFirst submitted to…
Summary of Sketch to Adapt: Fine-tunable Sketches For Efficient Llm Adaptation, by Tianyi Zhang et al.
Sketch to Adapt: Fine-Tunable Sketches for Efficient LLM Adaptationby Tianyi Zhang, Junda Su, Aditya Desai,…
Summary of Evolve: Evaluating and Optimizing Llms For Exploration, by Allen Nie et al.
EVOLvE: Evaluating and Optimizing LLMs For Explorationby Allen Nie, Yi Su, Bo Chang, Jonathan N.…
Summary of Mixture Compressor For Mixture-of-experts Llms Gains More, by Wei Huang et al.
Mixture Compressor for Mixture-of-Experts LLMs Gains Moreby Wei Huang, Yue Liao, Jianhui Liu, Ruifei He,…