Summary of Inattention: Linear Context Scaling For Transformers, by Joseph Eisner
InAttention: Linear Context Scaling for Transformersby Joseph EisnerFirst submitted to arxiv on: 9 Oct 2024CategoriesMain:…
Summary of Long-context Llms Meet Rag: Overcoming Challenges For Long Inputs in Rag, by Bowen Jin et al.
Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAGby Bowen Jin, Jinsung Yoon,…
Summary of Futurefill: Fast Generation From Convolutional Sequence Models, by Naman Agarwal et al.
FutureFill: Fast Generation from Convolutional Sequence Modelsby Naman Agarwal, Xinyi Chen, Evan Dogariu, Vlad Feinberg,…
Summary of On the Adaptation Of Unlimiformer For Decoder-only Transformers, by Kian Ahrabian et al.
On The Adaptation of Unlimiformer for Decoder-Only Transformersby Kian Ahrabian, Alon Benhaim, Barun Patra, Jay…
Summary of Discovering the Gems in Early Layers: Accelerating Long-context Llms with 1000x Input Token Reduction, by Zhenmei Shi et al.
Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reductionby Zhenmei…
Summary of Critiprefill: a Segment-wise Criticality-based Approach For Prefilling Acceleration in Llms, by Junlin Lv et al.
CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMsby Junlin Lv, Yuan Feng, Xike…
Summary of An Empirical Study on Context Length For Open-domain Dialog Generation, by Xinyi Shen et al.
An Empirical Study on Context Length for Open-Domain Dialog Generationby Xinyi Shen, Zuoquan LinFirst submitted…
Summary of Multilingual Needle in a Haystack: Investigating Long-context Behavior Of Multilingual Large Language Models, by Amey Hengle et al.
Multilingual Needle in a Haystack: Investigating Long-Context Behavior of Multilingual Large Language Modelsby Amey Hengle,…
Summary of Lampo: Large Language Models As Preference Machines For Few-shot Ordinal Classification, by Zhen Qin and Junru Wu and Jiaming Shen and Tianqi Liu and Xuanhui Wang
LAMPO: Large Language Models as Preference Machines for Few-shot Ordinal Classificationby Zhen Qin, Junru Wu,…
Summary of On the Benefits Of Rank in Attention Layers, by Noah Amsel et al.
On the Benefits of Rank in Attention Layersby Noah Amsel, Gilad Yehudai, Joan BrunaFirst submitted…