Summary of Svd-llm: Truncation-aware Singular Value Decomposition For Large Language Model Compression, by Xin Wang et al.
SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compressionby Xin Wang, Yu Zheng, Zhongwei…
Summary of Differentially Private Knowledge Distillation Via Synthetic Text Generation, by James Flemings and Murali Annavaram
Differentially Private Knowledge Distillation via Synthetic Text Generationby James Flemings, Murali AnnavaramFirst submitted to arxiv…
Summary of Model Compression Method For S4 with Diagonal State Space Layers Using Balanced Truncation, by Haruka Ezoe and Kazuhiro Sato
Model Compression Method for S4 with Diagonal State Space Layers using Balanced Truncationby Haruka Ezoe,…
Summary of Fingpt-hpc: Efficient Pretraining and Finetuning Large Language Models For Financial Applications with High-performance Computing, by Xiao-yang Liu et al.
FinGPT-HPC: Efficient Pretraining and Finetuning Large Language Models for Financial Applications with High-Performance Computingby Xiao-Yang…
Summary of Promptkd: Distilling Student-friendly Knowledge For Generative Language Models Via Prompt Tuning, by Gyeongman Kim et al.
PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuningby Gyeongman Kim, Doohyuk Jang,…
Summary of Bayesian Deep Learning Via Expectation Maximization and Turbo Deep Approximate Message Passing, by Wei Xu et al.
Bayesian Deep Learning Via Expectation Maximization and Turbo Deep Approximate Message Passingby Wei Xu, An…
Summary of A Survey on Transformer Compression, by Yehui Tang et al.
A Survey on Transformer Compressionby Yehui Tang, Yunhe Wang, Jianyuan Guo, Zhijun Tu, Kai Han,…
Summary of L4q: Parameter Efficient Quantization-aware Fine-tuning on Large Language Models, by Hyesung Jeon et al.
L4Q: Parameter Efficient Quantization-Aware Fine-Tuning on Large Language Modelsby Hyesung Jeon, Yulhwa Kim, Jae-joon KimFirst…
Summary of Fed-cvlc: Compressing Federated Learning Communications with Variable-length Codes, by Xiaoxin Su et al.
Fed-CVLC: Compressing Federated Learning Communications with Variable-Length Codesby Xiaoxin Su, Yipeng Zhou, Laizhong Cui, John…
Summary of Faster and Lighter Llms: a Survey on Current Challenges and Way Forward, by Arnav Chavan et al.
Faster and Lighter LLMs: A Survey on Current Challenges and Way Forwardby Arnav Chavan, Raghav…