Summary of Large Language Models Are Overparameterized Text Encoders, by Thennal D K et al.
Large Language Models Are Overparameterized Text Encodersby Thennal D K, Tim Fischer, Chris BiemannFirst submitted…
Summary of The Propensity For Density in Feed-forward Models, by Nandi Schoots et al.
The Propensity for Density in Feed-forward Modelsby Nandi Schoots, Alex Jackson, Ali Kholmovaia, Peter McBurney,…
Summary of Gder: Safeguarding Efficiency, Balancing, and Robustness Via Prototypical Graph Pruning, by Guibin Zhang et al.
GDeR: Safeguarding Efficiency, Balancing, and Robustness via Prototypical Graph Pruningby Guibin Zhang, Haonan Dong, Yuchen…
Summary of A Unified View Of Delta Parameter Editing in Post-trained Large-scale Models, by Qiaoyu Tang et al.
A Unified View of Delta Parameter Editing in Post-Trained Large-Scale Modelsby Qiaoyu Tang, Le Yu,…
Summary of Llm-rank: a Graph Theoretical Approach to Pruning Large Language Models, by David Hoffmann et al.
LLM-Rank: A Graph Theoretical Approach to Pruning Large Language Modelsby David Hoffmann, Kailash Budhathoki, Matthaeus…
Summary of Disp-llm: Dimension-independent Structural Pruning For Large Language Models, by Shangqian Gao and Chi-heng Lin and Ting Hua and Tang Zheng and Yilin Shen and Hongxia Jin and Yen-chang Hsu
DISP-LLM: Dimension-Independent Structural Pruning for Large Language Modelsby Shangqian Gao, Chi-Heng Lin, Ting Hua, Tang…
Summary of Moe-pruner: Pruning Mixture-of-experts Large Language Model Using the Hints From Its Router, by Yanyue Xie et al.
MoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Routerby Yanyue Xie, Zhi…
Summary of Beyond Linear Approximations: a Novel Pruning Approach For Attention Matrix, by Yingyu Liang et al.
Beyond Linear Approximations: A Novel Pruning Approach for Attention Matrixby Yingyu Liang, Jiangxuan Long, Zhenmei…
Summary of Alphapruning: Using Heavy-tailed Self Regularization Theory For Improved Layer-wise Pruning Of Large Language Models, by Haiquan Lu et al.
AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Modelsby Haiquan…
Summary of Enhancing Vision-language Model Pre-training with Image-text Pair Pruning Based on Word Frequency, by Mingliang Liang et al.
Enhancing Vision-Language Model Pre-training with Image-text Pair Pruning Based on Word Frequencyby Mingliang Liang, Martha…