Summary of Discrete Distributions Are Learnable From Metastable Samples, by Abhijith Jayakumar et al.
Discrete distributions are learnable from metastable samplesby Abhijith Jayakumar, Andrey Y. Lokhov, Sidhant Misra, Marc…
Summary of Artificial Kuramoto Oscillatory Neurons, by Takeru Miyato et al.
Artificial Kuramoto Oscillatory Neuronsby Takeru Miyato, Sindy Löwe, Andreas Geiger, Max WellingFirst submitted to arxiv…
Summary of A Common Pitfall Of Margin-based Language Model Alignment: Gradient Entanglement, by Hui Yuan et al.
A Common Pitfall of Margin-based Language Model Alignment: Gradient Entanglementby Hui Yuan, Yifan Zeng, Yue…
Summary of Unearthing Skill-level Insights For Understanding Trade-offs Of Foundation Models, by Mazda Moayeri et al.
Unearthing Skill-Level Insights for Understanding Trade-Offs of Foundation Modelsby Mazda Moayeri, Vidhisha Balachandran, Varun Chandrasekaran,…
Summary of The Disparate Benefits Of Deep Ensembles, by Kajetan Schweighofer et al.
The Disparate Benefits of Deep Ensemblesby Kajetan Schweighofer, Adrian Arnaiz-Rodriguez, Sepp Hochreiter, Nuria OliverFirst submitted…
Summary of Active-dormant Attention Heads: Mechanistically Demystifying Extreme-token Phenomena in Llms, by Tianyu Guo et al.
Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMsby Tianyu Guo, Druv Pai, Yu Bai,…
Summary of Orso: Accelerating Reward Design Via Online Reward Selection and Policy Optimization, by Chen Bo Calvin Zhang et al.
ORSO: Accelerating Reward Design via Online Reward Selection and Policy Optimizationby Chen Bo Calvin Zhang,…
Summary of A Unified View Of Delta Parameter Editing in Post-trained Large-scale Models, by Qiaoyu Tang et al.
A Unified View of Delta Parameter Editing in Post-Trained Large-Scale Modelsby Qiaoyu Tang, Le Yu,…
Summary of Lighttransfer: Your Long-context Llm Is Secretly a Hybrid Model with Effortless Adaptation, by Xuan Zhang et al.
LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptationby Xuan Zhang, Fengzhuo…
Summary of Influence Functions For Scalable Data Attribution in Diffusion Models, by Bruno Mlodozeniec et al.
Influence Functions for Scalable Data Attribution in Diffusion Modelsby Bruno Mlodozeniec, Runa Eschenhagen, Juhan Bae,…