Summary of Moreaupruner: Robust Pruning Of Large Language Models Against Weight Perturbations, by Zixiao Wang et al.
MoreauPruner: Robust Pruning of Large Language Models against Weight Perturbationsby Zixiao Wang, Jingwei Zhang, Wenqian…
Summary of Advancing Tool-augmented Large Language Models: Integrating Insights From Errors in Inference Trees, by Sijia Chen et al.
Advancing Tool-Augmented Large Language Models: Integrating Insights from Errors in Inference Treesby Sijia Chen, Yibo…
Summary of Switchlora: Switched Low-rank Adaptation Can Learn Full-rank Information, by Kaiye Zhou et al.
SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Informationby Kaiye Zhou, Shucheng Wang, Jun XuFirst submitted…
Summary of Natural Language Interaction with a Household Electricity Knowledge-based Digital Twin, by Carolina Fortuna et al.
Natural Language Interaction with a Household Electricity Knowledge-based Digital Twinby Carolina Fortuna, Vid Hanžel, Blaž…
Summary of Assessing the Emergent Symbolic Reasoning Abilities Of Llama Large Language Models, by Flavio Petruzzellis et al.
Assessing the Emergent Symbolic Reasoning Abilities of Llama Large Language Modelsby Flavio Petruzzellis, Alberto Testolin,…
Summary of Large Language Model Confidence Estimation Via Black-box Access, by Tejaswini Pedapati et al.
Large Language Model Confidence Estimation via Black-Box Accessby Tejaswini Pedapati, Amit Dhurandhar, Soumya Ghosh, Soham…
Summary of Does Your Data Spark Joy? Performance Gains From Domain Upsampling at the End Of Training, by Cody Blakeney et al.
Does your data spark joy? Performance gains from domain upsampling at the end of trainingby…
Summary of Pruner-zero: Evolving Symbolic Pruning Metric From Scratch For Large Language Models, by Peijie Dong and Lujun Li and Zhenheng Tang and Xiang Liu and Xinglin Pan and Qiang Wang and Xiaowen Chu
Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Modelsby Peijie Dong, Lujun Li,…
Summary of Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Tasks, by Andrew Gambardella et al.
Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Tasksby Andrew Gambardella,…
Summary of Sltrain: a Sparse Plus Low-rank Approach For Parameter and Memory Efficient Pretraining, by Andi Han et al.
SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretrainingby Andi Han, Jiaxiang…