Summary of Mixlora: Enhancing Large Language Models Fine-tuning with Lora-based Mixture Of Experts, by Dengchun Li and Yingzi Ma and Naizheng Wang and Zhengmao Ye and Zhiyuan Cheng and Yinghao Tang and Yan Zhang and Lei Duan and Jie Zuo and Cal Yang and Mingjie Tang
MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Expertsby Dengchun Li, Yingzi Ma,…