Summary of Two Are Better Than One: Context Window Extension with Multi-grained Self-injection, by Wei Han et al.
Two are better than one: Context window extension with multi-grained self-injectionby Wei Han, Pan Zhou,…
Summary of Bridging the Training-inference Gap in Llms by Leveraging Self-generated Tokens, By Zhepeng Cen and Yao Liu and Siliang Zeng and Pratik Chaudhari and Huzefa Rangwala and George Karypis and Rasool Fakoor
Bridging the Training-Inference Gap in LLMs by Leveraging Self-Generated Tokensby Zhepeng Cen, Yao Liu, Siliang…
Summary of What Do Llms Need to Understand Graphs: a Survey Of Parametric Representation Of Graphs, by Dongqi Fu et al.
What Do LLMs Need to Understand Graphs: A Survey of Parametric Representation of Graphsby Dongqi…
Summary of Enhancing Jepas with Spatial Conditioning: Robust and Efficient Representation Learning, by Etai Littwin et al.
Enhancing JEPAs with Spatial Conditioning: Robust and Efficient Representation Learningby Etai Littwin, Vimal Thilak, Anand…
Summary of Interpolating Video-llms: Toward Longer-sequence Lmms in a Training-free Manner, by Yuzhang Shang et al.
Interpolating Video-LLMs: Toward Longer-sequence LMMs in a Training-free Mannerby Yuzhang Shang, Bingxin Xu, Weitai Kang,…
Summary of Chatqa 2: Bridging the Gap to Proprietary Llms in Long Context and Rag Capabilities, by Peng Xu et al.
ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilitiesby Peng…
Summary of Towards a Theory Of How the Structure Of Language Is Acquired by Deep Neural Networks, By Francesco Cagnetta et al.
Towards a theory of how the structure of language is acquired by deep neural networksby…
Summary of Exploring Context Window Of Large Language Models Via Decomposed Positional Vectors, by Zican Dong et al.
Exploring Context Window of Large Language Models via Decomposed Positional Vectorsby Zican Dong, Junyi Li,…
Summary of Longembed: Extending Embedding Models For Long Context Retrieval, by Dawei Zhu et al.
LongEmbed: Extending Embedding Models for Long Context Retrievalby Dawei Zhu, Liang Wang, Nan Yang, Yifan…
Summary of Lloco: Learning Long Contexts Offline, by Sijun Tan et al.
LLoCO: Learning Long Contexts Offlineby Sijun Tan, Xiuyu Li, Shishir Patil, Ziyang Wu, Tianjun Zhang,…