Summary of Efficient Llm Inference Using Dynamic Input Pruning and Cache-aware Masking, by Marco Federici et al.
Efficient LLM Inference using Dynamic Input Pruning and Cache-Aware Maskingby Marco Federici, Davide Belli, Mart…
Summary of Token Cropr: Faster Vits For Quite a Few Tasks, by Benjamin Bergner et al.
Token Cropr: Faster ViTs for Quite a Few Tasksby Benjamin Bergner, Christoph Lippert, Aravindh MahendranFirst…
Summary of Mixture Of Cache-conditional Experts For Efficient Mobile Device Inference, by Andrii Skliar et al.
Mixture of Cache-Conditional Experts for Efficient Mobile Device Inferenceby Andrii Skliar, Ties van Rozendaal, Romain…
Summary of Accelerating Multimodal Large Language Models Via Dynamic Visual-token Exit and the Empirical Findings, by Qiong Wu et al.
Accelerating Multimodal Large Language Models via Dynamic Visual-Token Exit and the Empirical Findingsby Qiong Wu,…
Summary of Attamba: Attending to Multi-token States, by Yash Akhauri et al.
Attamba: Attending To Multi-Token Statesby Yash Akhauri, Safeen Huda, Mohamed S. AbdelfattahFirst submitted to arxiv…
Summary of Ensuring Fair Llm Serving Amid Diverse Applications, by Redwan Ibne Seraj Khan et al.
Ensuring Fair LLM Serving Amid Diverse Applicationsby Redwan Ibne Seraj Khan, Kunal Jain, Haiying Shen,…
Summary of Improving Next Tokens Via Second-to-last Predictions with Generate and Refine, by Johannes Schneider
Improving Next Tokens via Second-to-Last Predictions with Generate and Refineby Johannes SchneiderFirst submitted to arxiv…
Summary of Transforming Nlu with Babylon: a Case Study in Development Of Real-time, Edge-efficient, Multi-intent Translation System For Automated Drive-thru Ordering, by Mostafa Varzaneh et al.
Transforming NLU with Babylon: A Case Study in Development of Real-time, Edge-Efficient, Multi-Intent Translation System…
Summary of Text Embedding Is Not All You Need: Attention Control For Text-to-image Semantic Alignment with Text Self-attention Maps, by Jeeyung Kim et al.
Text Embedding is Not All You Need: Attention Control for Text-to-Image Semantic Alignment with Text…
Summary of Headrouter: a Training-free Image Editing Framework For Mm-dits by Adaptively Routing Attention Heads, By Yu Xu et al.
HeadRouter: A Training-free Image Editing Framework for MM-DiTs by Adaptively Routing Attention Headsby Yu Xu,…