Summary of Beyond Kv Caching: Shared Attention For Efficient Llms, by Bingli Liao and Danilo Vasconcellos Vargas
Beyond KV Caching: Shared Attention for Efficient LLMsby Bingli Liao, Danilo Vasconcellos VargasFirst submitted to…
Summary of Lookupvit: Compressing Visual Information to a Limited Number Of Tokens, by Rajat Koner et al.
LookupViT: Compressing visual information to a limited number of tokensby Rajat Koner, Gagan Jain, Prateek…
Summary of Mamba-ptq: Outlier Channels in Recurrent Large Language Models, by Alessandro Pierro et al.
Mamba-PTQ: Outlier Channels in Recurrent Large Language Modelsby Alessandro Pierro, Steven AbreuFirst submitted to arxiv…
Summary of Analyzing the Generalization and Reliability Of Steering Vectors, by Daniel Tan et al.
Analyzing the Generalization and Reliability of Steering Vectorsby Daniel Tan, David Chanin, Aengus Lynch, Dimitrios…
Summary of Utg: Towards a Unified View Of Snapshot and Event Based Models For Temporal Graphs, by Shenyang Huang et al.
UTG: Towards a Unified View of Snapshot and Event Based Models for Temporal Graphsby Shenyang…
Summary of When Can Transformers Compositionally Generalize In-context?, by Seijin Kobayashi et al.
When can transformers compositionally generalize in-context?by Seijin Kobayashi, Simon Schug, Yassir Akram, Florian Redhardt, Johannes…
Summary of Spectra: Surprising Effectiveness Of Pretraining Ternary Language Models at Scale, by Ayush Kaushal et al.
Spectra: Surprising Effectiveness of Pretraining Ternary Language Models at Scaleby Ayush Kaushal, Tejas Vaidhya, Arnab…
Summary of Tiled Bit Networks: Sub-bit Neural Network Compression Through Reuse Of Learnable Binary Vectors, by Matt Gorbett et al.
Tiled Bit Networks: Sub-Bit Neural Network Compression Through Reuse of Learnable Binary Vectorsby Matt Gorbett,…
Summary of Enhancing Split Computing and Early Exit Applications Through Predefined Sparsity, by Luigi Capogrosso et al.
Enhancing Split Computing and Early Exit Applications through Predefined Sparsityby Luigi Capogrosso, Enrico Fraccaroli, Giulio…
Summary of Pipeinfer: Accelerating Llm Inference Using Asynchronous Pipelined Speculation, by Branden Butler et al.
PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculationby Branden Butler, Sixing Yu, Arya Mazaheri, Ali…