Summary of Understanding Warmup-stable-decay Learning Rates: a River Valley Loss Landscape Perspective, by Kaiyue Wen et al.
Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspectiveby Kaiyue Wen, Zhiyuan Li, Jason…
Summary of Dept: Decoupled Embeddings For Pre-training Language Models, by Alex Iacob et al.
DEPT: Decoupled Embeddings for Pre-training Language Modelsby Alex Iacob, Lorenzo Sani, Meghdad Kurmanji, William F.…
Summary of Learning How Hard to Think: Input-adaptive Allocation Of Lm Computation, by Mehul Damani et al.
Learning How Hard to Think: Input-Adaptive Allocation of LM Computationby Mehul Damani, Idan Shenfeld, Andi…
Summary of Language Model-driven Data Pruning Enables Efficient Active Learning, by Abdul Hameed Azeemi et al.
Language Model-Driven Data Pruning Enables Efficient Active Learningby Abdul Hameed Azeemi, Ihsan Ayyub Qazi, Agha…
Summary of Mixture Of Attentions For Speculative Decoding, by Matthieu Zimmer et al.
Mixture of Attentions For Speculative Decodingby Matthieu Zimmer, Milan Gritta, Gerasimos Lampouras, Haitham Bou Ammar,…
Summary of Can Mamba Always Enjoy the “free Lunch”?, by Ruifeng Ren et al.
Can Mamba Always Enjoy the “Free Lunch”?by Ruifeng Ren, Zhicong Li, Yong LiuFirst submitted to…
Summary of Aime: Ai System Optimization Via Multiple Llm Evaluators, by Bhrij Patel et al.
AIME: AI System Optimization via Multiple LLM Evaluatorsby Bhrij Patel, Souradip Chakraborty, Wesley A. Suttle,…
Summary of Permissive Information-flow Analysis For Large Language Models, by Shoaib Ahmed Siddiqui et al.
Permissive Information-Flow Analysis for Large Language Modelsby Shoaib Ahmed Siddiqui, Radhika Gaonkar, Boris Köpf, David…
Summary of Metaood: Automatic Selection Of Ood Detection Models, by Yuehan Qin et al.
MetaOOD: Automatic Selection of OOD Detection Modelsby Yuehan Qin, Yichi Zhang, Yi Nian, Xueying Ding,…
Summary of Fine-tuning Language Models with Differential Privacy Through Adaptive Noise Allocation, by Xianzhi Li et al.
Fine-Tuning Language Models with Differential Privacy through Adaptive Noise Allocationby Xianzhi Li, Ran Zmigrod, Zhiqiang…