Summary of Inattention: Linear Context Scaling For Transformers, by Joseph Eisner
InAttention: Linear Context Scaling for Transformersby Joseph EisnerFirst submitted to arxiv on: 9 Oct 2024CategoriesMain:…
Summary of Long-context Llms Meet Rag: Overcoming Challenges For Long Inputs in Rag, by Bowen Jin et al.
Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAGby Bowen Jin, Jinsung Yoon,…
Summary of Futurefill: Fast Generation From Convolutional Sequence Models, by Naman Agarwal et al.
FutureFill: Fast Generation from Convolutional Sequence Modelsby Naman Agarwal, Xinyi Chen, Evan Dogariu, Vlad Feinberg,…
Summary of On the Adaptation Of Unlimiformer For Decoder-only Transformers, by Kian Ahrabian et al.
On The Adaptation of Unlimiformer for Decoder-Only Transformersby Kian Ahrabian, Alon Benhaim, Barun Patra, Jay…
Summary of Discovering the Gems in Early Layers: Accelerating Long-context Llms with 1000x Input Token Reduction, by Zhenmei Shi et al.
Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reductionby Zhenmei…
Summary of Critiprefill: a Segment-wise Criticality-based Approach For Prefilling Acceleration in Llms, by Junlin Lv et al.
CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMsby Junlin Lv, Yuan Feng, Xike…
Summary of An Empirical Study on Context Length For Open-domain Dialog Generation, by Xinyi Shen et al.
An Empirical Study on Context Length for Open-Domain Dialog Generationby Xinyi Shen, Zuoquan LinFirst submitted…