Summary of Lora-fair: Federated Lora Fine-tuning with Aggregation and Initialization Refinement, by Jieming Bian et al.
LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinementby Jieming Bian, Lei Wang, Letian Zhang,…
Summary of Automixq: Self-adjusting Quantization For High Performance Memory-efficient Fine-tuning, by Changhai Zhou et al.
AutoMixQ: Self-Adjusting Quantization for High Performance Memory-Efficient Fine-Tuningby Changhai Zhou, Shiyang Zhang, Yuhua Zhou, Zekai…
Summary of On the Way to Llm Personalization: Learning to Remember User Conversations, by Lucie Charlotte Magister et al.
On the Way to LLM Personalization: Learning to Remember User Conversationsby Lucie Charlotte Magister, Katherine…
Summary of Federated Low-rank Adaptation with Differential Privacy Over Wireless Networks, by Tianqu Kang et al.
Federated Low-Rank Adaptation with Differential Privacy over Wireless Networksby Tianqu Kang, Zixin Wang, Hengtao He,…
Summary of Llm-neo: Parameter Efficient Knowledge Distillation For Large Language Models, by Runming Yang et al.
LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Modelsby Runming Yang, Taiqiang Wu, Jiahao Wang,…
Summary of Federated Llms Fine-tuned with Adaptive Importance-aware Lora, by Yang Su et al.
Federated LLMs Fine-tuned with Adaptive Importance-Aware LoRAby Yang Su, Na Yan, Yansha DengFirst submitted to…
Summary of Llm-r: a Framework For Domain-adaptive Maintenance Scheme Generation Combining Hierarchical Agents and Rag, by Laifa Tao et al.
LLM-R: A Framework for Domain-Adaptive Maintenance Scheme Generation Combining Hierarchical Agents and RAGby Laifa Tao,…
Summary of Variational Low-rank Adaptation Using Ivon, by Bai Cong et al.
Variational Low-Rank Adaptation Using IVONby Bai Cong, Nico Daheim, Yuesong Shen, Daniel Cremers, Rio Yokota,…
Summary of Dual Low-rank Adaptation For Continual Learning with Pre-trained Models, by Huancheng Chen and Jingtao Li and Nidham Gazagnadou and Weiming Zhuang and Chen Chen and Lingjuan Lyu
Dual Low-Rank Adaptation for Continual Learning with Pre-Trained Modelsby Huancheng Chen, Jingtao Li, Nidham Gazagnadou,…
Summary of Exploring Gradient Subspaces: Addressing and Overcoming Lora’s Limitations in Federated Fine-tuning Of Large Language Models, by Navyansh Mahla et al.
Exploring Gradient Subspaces: Addressing and Overcoming LoRA’s Limitations in Federated Fine-Tuning of Large Language Modelsby…