Summary of Towards An Empirical Understanding Of Moe Design Choices, by Dongyang Fan et al.
Towards an empirical understanding of MoE design choicesby Dongyang Fan, Bettina Messmer, Martin JaggiFirst submitted…
Summary of Emulated Disalignment: Safety Alignment For Large Language Models May Backfire!, by Zhanhui Zhou et al.
Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!by Zhanhui Zhou, Jie Liu, Zhichen…
Summary of Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-correct Decoding, by Hanling Yi et al.
Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decodingby Hanling Yi,…
Summary of Mars: Meaning-aware Response Scoring For Uncertainty Estimation in Generative Llms, by Yavuz Faruk Bakman et al.
MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMsby Yavuz Faruk Bakman, Duygu Nur…
Summary of The Evolution Of Statistical Induction Heads: In-context Learning Markov Chains, by Benjamin L. Edelman et al.
The Evolution of Statistical Induction Heads: In-Context Learning Markov Chainsby Benjamin L. Edelman, Ezra Edelman,…
Summary of Edgeqat: Entropy and Distribution Guided Quantization-aware Training For the Acceleration Of Lightweight Llms on the Edge, by Xuan Shen et al.
EdgeQAT: Entropy and Distribution Guided Quantization-Aware Training for the Acceleration of Lightweight LLMs on the…
Summary of Bidirectional Generative Pre-training For Improving Healthcare Time-series Representation Learning, by Ziyang Song et al.
Bidirectional Generative Pre-training for Improving Healthcare Time-series Representation Learningby Ziyang Song, Qincheng Lu, He Zhu,…
Summary of Graph Mamba: Towards Learning on Graphs with State Space Models, by Ali Behrouz and Farnoosh Hashemi
Graph Mamba: Towards Learning on Graphs with State Space Modelsby Ali Behrouz, Farnoosh HashemiFirst submitted…
Summary of Llaga: Large Language and Graph Assistant, by Runjin Chen et al.
LLaGA: Large Language and Graph Assistantby Runjin Chen, Tong Zhao, Ajay Jaiswal, Neil Shah, Zhangyang…
Summary of Autonomous Data Selection with Zero-shot Generative Classifiers For Mathematical Texts, by Yifan Zhang et al.
Autonomous Data Selection with Zero-shot Generative Classifiers for Mathematical Textsby Yifan Zhang, Yifan Luo, Yang…