Summary of Magr: Weight Magnitude Reduction For Enhancing Post-training Quantization, by Aozhong Zhang et al.
MagR: Weight Magnitude Reduction for Enhancing Post-Training Quantizationby Aozhong Zhang, Naigang Wang, Yanxia Deng, Xin…
Summary of Perplexed by Perplexity: Perplexity-based Data Pruning with Small Reference Models, By Zachary Ankner et al.
Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Modelsby Zachary Ankner, Cody Blakeney, Kartik…
Summary of On the Noise Robustness Of In-context Learning For Text Generation, by Hongfu Gao et al.
On the Noise Robustness of In-Context Learning for Text Generationby Hongfu Gao, Feipeng Zhang, Wenyu…
Summary of Slim-llm: Salience-driven Mixed-precision Quantization For Large Language Models, by Wei Huang et al.
SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Modelsby Wei Huang, Haotong Qin, Yangdong Liu, Yawei…
Summary of Hw-gpt-bench: Hardware-aware Architecture Benchmark For Language Models, by Rhea Sanjay Sukthanker et al.
HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Modelsby Rhea Sanjay Sukthanker, Arber Zela, Benedikt Staffler, Aaron…
Summary of Improving Transformers with Dynamically Composable Multi-head Attention, by Da Xiao et al.
Improving Transformers with Dynamically Composable Multi-Head Attentionby Da Xiao, Qingye Meng, Shengping Li, Xingyuan YuanFirst…
Summary of State-free Inference Of State-space Models: the Transfer Function Approach, by Rom N. Parnichkun et al.
State-Free Inference of State-Space Models: The Transfer Function Approachby Rom N. Parnichkun, Stefano Massaroli, Alessandro…
Summary of Lory: Fully Differentiable Mixture-of-experts For Autoregressive Language Model Pre-training, by Zexuan Zhong et al.
Lory: Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-trainingby Zexuan Zhong, Mengzhou Xia, Danqi Chen,…
Summary of M-dew: Extending Dynamic Ensemble Weighting to Handle Missing Values, by Adam Catto et al.
M-DEW: Extending Dynamic Ensemble Weighting to Handle Missing Valuesby Adam Catto, Nan Jia, Ansaf Salleb-Aouissi,…
Summary of Benchmarking Benchmark Leakage in Large Language Models, by Ruijie Xu et al.
Benchmarking Benchmark Leakage in Large Language Modelsby Ruijie Xu, Zengzhi Wang, Run-Ze Fan, Pengfei LiuFirst…