Summary of Lloco: Learning Long Contexts Offline, by Sijun Tan et al.
LLoCO: Learning Long Contexts Offlineby Sijun Tan, Xiuyu Li, Shishir Patil, Ziyang Wu, Tianjun Zhang,…
Summary of Progressive Semantic-guided Vision Transformer For Zero-shot Learning, by Shiming Chen et al.
Progressive Semantic-Guided Vision Transformer for Zero-Shot Learningby Shiming Chen, Wenjin Hou, Salman Khan, Fahad Shahbaz…
Summary of Interactive Prompt Debugging with Sequence Salience, by Ian Tenney et al.
Interactive Prompt Debugging with Sequence Salienceby Ian Tenney, Ryan Mullins, Bin Du, Shree Pandya, Minsuk…
Summary of Softmax Attention with Constant Cost Per Token, by Franz A. Heinsen
Softmax Attention with Constant Cost per Tokenby Franz A. HeinsenFirst submitted to arxiv on: 8…
Summary of Technical Report: the Graph Spectral Token — Enhancing Graph Transformers with Spectral Information, by Zihan Pengmei et al.
Technical Report: The Graph Spectral Token – Enhancing Graph Transformers with Spectral Informationby Zihan Pengmei,…
Summary of To Cool or Not to Cool? Temperature Network Meets Large Foundation Models Via Dro, by Zi-hao Qiu et al.
To Cool or not to Cool? Temperature Network Meets Large Foundation Models via DROby Zi-Hao…
Summary of Ffn-skipllm: a Hidden Gem For Autoregressive Decoding with Adaptive Feed Forward Skipping, by Ajay Jaiswal et al.
FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skippingby Ajay Jaiswal, Bodun…
Summary of Mixture-of-depths: Dynamically Allocating Compute in Transformer-based Language Models, by David Raposo et al.
Mixture-of-Depths: Dynamically allocating compute in transformer-based language modelsby David Raposo, Sam Ritter, Blake Richards, Timothy…
Summary of Token Trails: Navigating Contextual Depths in Conversational Ai with Chatllm, by Md. Kowsher et al.
Token Trails: Navigating Contextual Depths in Conversational AI with ChatLLMby Md. Kowsher, Ritesh Panditi, Nusrat…
Summary of Explaining Large Language Models Decisions Using Shapley Values, by Behnam Mohammadi
Explaining Large Language Models Decisions Using Shapley Valuesby Behnam MohammadiFirst submitted to arxiv on: 29…