Summary of Progressive Mixed-precision Decoding For Efficient Llm Inference, by Hao Mark Chen et al.
Progressive Mixed-Precision Decoding for Efficient LLM Inferenceby Hao Mark Chen, Fuwen Tan, Alexandros Kouris, Royson…
Summary of A Theoretical Perspective on Mode Collapse in Variational Inference, by Roman Soletskyi et al.
A theoretical perspective on mode collapse in variational inferenceby Roman Soletskyi, Marylou Gabrié, Bruno LoureiroFirst…
Summary of Llm-rank: a Graph Theoretical Approach to Pruning Large Language Models, by David Hoffmann et al.
LLM-Rank: A Graph Theoretical Approach to Pruning Large Language Modelsby David Hoffmann, Kailash Budhathoki, Matthaeus…
Summary of Biasjailbreak:analyzing Ethical Biases and Jailbreak Vulnerabilities in Large Language Models, by Isack Lee et al.
BiasJailbreak:Analyzing Ethical Biases and Jailbreak Vulnerabilities in Large Language Modelsby Isack Lee, Haebin SeongFirst submitted…
Summary of Gesubnet: Gene Interaction Inference For Disease Subtype Network Generation, by Ziwei Yang et al.
GeSubNet: Gene Interaction Inference for Disease Subtype Network Generationby Ziwei Yang, Zheng Chen, Xin Liu,…
Summary of Aero: Softmax-only Llms For Efficient Private Inference, by Nandan Kumar Jha and Brandon Reagen
AERO: Softmax-Only LLMs for Efficient Private Inferenceby Nandan Kumar Jha, Brandon ReagenFirst submitted to arxiv…
Summary of Self-comparison For Dataset-level Membership Inference in Large (vision-)language Models, by Jie Ren et al.
Self-Comparison for Dataset-Level Membership Inference in Large (Vision-)Language Modelsby Jie Ren, Kangrui Chen, Chen Chen,…
Summary of In-context Kv-cache Eviction For Llms Via Attention-gate, by Zihao Zeng et al.
In-context KV-Cache Eviction for LLMs via Attention-Gateby Zihao Zeng, Bokai Lin, Tianqi Hou, Hao Zhang,…
Summary of Flash Inference: Near Linear Time Inference For Long Convolution Sequence Models and Beyond, by Costin-andrei Oncescu et al.
Flash Inference: Near Linear Time Inference for Long Convolution Sequence Models and Beyondby Costin-Andrei Oncescu,…
Summary of Recurformer: Not All Transformer Heads Need Self-attention, by Ruiqing Yan et al.
RecurFormer: Not All Transformer Heads Need Self-Attentionby Ruiqing Yan, Linghan Zheng, Xingbo Du, Han Zou,…