Summary of Lora-pro: Are Low-rank Adapters Properly Optimized?, by Zhengbo Wang et al.
LoRA-Pro: Are Low-Rank Adapters Properly Optimized?by Zhengbo Wang, Jian Liang, Ran He, Zilei Wang, Tieniu…
Summary of Accurate and Efficient Fine-tuning Of Quantized Large Language Models Through Optimal Balance, by Ao Shen et al.
Accurate and Efficient Fine-Tuning of Quantized Large Language Models Through Optimal Balanceby Ao Shen, Qiang…
Summary of Rapid Switching and Multi-adapter Fusion Via Sparse High Rank Adapters, by Kartikeya Bhardwaj et al.
Rapid Switching and Multi-Adapter Fusion via Sparse High Rank Adaptersby Kartikeya Bhardwaj, Nilesh Prasad Pandey,…
Summary of Enhancing Parameter Efficiency and Generalization in Large-scale Models: a Regularized and Masked Low-rank Adaptation Approach, by Yuzhu Mao et al.
Enhancing Parameter Efficiency and Generalization in Large-Scale Models: A Regularized and Masked Low-Rank Adaptation Approachby…
Summary of A Survey on Lora Of Large Language Models, by Yuren Mao et al.
A Survey on LoRA of Large Language Modelsby Yuren Mao, Yuhang Ge, Yijiang Fan, Wenyi…
Summary of Datadream: Few-shot Guided Dataset Generation, by Jae Myung Kim et al.
DataDream: Few-shot Guided Dataset Generationby Jae Myung Kim, Jessica Bader, Stephan Alaniz, Cordelia Schmid, Zeynep…
Summary of On Large Language Model Continual Unlearning, by Chongyang Gao et al.
On Large Language Model Continual Unlearningby Chongyang Gao, Lixu Wang, Kaize Ding, Chenkai Weng, Xiao…
Summary of Rolora: Fine-tuning Rotated Outlier-free Llms For Effective Weight-activation Quantization, by Xijie Huang et al.
RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantizationby Xijie Huang, Zechun Liu, Shih-Yang Liu,…
Summary of Rosa: Random Subspace Adaptation For Efficient Fine-tuning, by Marawan Gamal Abdel Hameed et al.
ROSA: Random Subspace Adaptation for Efficient Fine-Tuningby Marawan Gamal Abdel Hameed, Aristides Milios, Siva Reddy,…
Summary of If You Don’t Understand It, Don’t Use It: Eliminating Trojans with Filters Between Layers, by Adriano Hernandez
If You Don’t Understand It, Don’t Use It: Eliminating Trojans with Filters Between Layersby Adriano…