Summary of Scaling Laws For Multilingual Language Models, by Yifei He et al.
Scaling Laws for Multilingual Language Modelsby Yifei He, Alon Benhaim, Barun Patra, Praneetha Vaddamanu, Sanchit…
Summary of Adaptive Data Optimization: Dynamic Sample Selection with Scaling Laws, by Yiding Jiang et al.
Adaptive Data Optimization: Dynamic Sample Selection with Scaling Lawsby Yiding Jiang, Allan Zhou, Zhili Feng,…
Summary of Tsds: Data Selection For Task-specific Model Finetuning, by Zifan Liu et al.
TSDS: Data Selection for Task-Specific Model Finetuningby Zifan Liu, Amin Karbasi, Theodoros RekatsinasFirst submitted to…
Summary of Fine-tuning Can Help Detect Pretraining Data From Large Language Models, by Hengxiang Zhang et al.
Fine-tuning can Help Detect Pretraining Data from Large Language Modelsby Hengxiang Zhang, Songxin Zhang, Bingyi…
Summary of Enhancing Jepas with Spatial Conditioning: Robust and Efficient Representation Learning, by Etai Littwin et al.
Enhancing JEPAs with Spatial Conditioning: Robust and Efficient Representation Learningby Etai Littwin, Vimal Thilak, Anand…
Summary of Graphclip: Enhancing Transferability in Graph Foundation Models For Text-attributed Graphs, by Yun Zhu et al.
GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphsby Yun Zhu, Haizhou Shi, Xiaotang…
Summary of Gift-eval: a Benchmark For General Time Series Forecasting Model Evaluation, by Taha Aksu et al.
GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationby Taha Aksu, Gerald Woo, Juncheng…
Summary of Lolcats: on Low-rank Linearizing Of Large Language Models, by Michael Zhang et al.
LoLCATs: On Low-Rank Linearizing of Large Language Modelsby Michael Zhang, Simran Arora, Rahul Chalamala, Alan…
Summary of Tapweight: Reweighting Pretraining Objectives For Task-adaptive Pretraining, by Ruiyi Zhang et al.
TapWeight: Reweighting Pretraining Objectives for Task-Adaptive Pretrainingby Ruiyi Zhang, Sai Ashish Somayajula, Pengtao XieFirst submitted…
Summary of Uncovering, Explaining, and Mitigating the Superficial Safety Of Backdoor Defense, by Rui Min et al.
Uncovering, Explaining, and Mitigating the Superficial Safety of Backdoor Defenseby Rui Min, Zeyu Qin, Nevin…