Summary of Lora Training in the Ntk Regime Has No Spurious Local Minima, by Uijeong Jang et al.
LoRA Training in the NTK Regime has No Spurious Local Minimaby Uijeong Jang, Jason D.…
Summary of Qdylora: Quantized Dynamic Low-rank Adaptation For Efficient Large Language Model Tuning, by Hossein Rajabzadeh et al.
QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuningby Hossein Rajabzadeh, Mojtaba Valipour,…
Summary of Lora-drop: Efficient Lora Parameter Pruning Based on Output Evaluation, by Hongyun Zhou et al.
LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluationby Hongyun Zhou, Xiangyu Lu, Wang Xu,…
Summary of Flora: Low-rank Adapters Are Secretly Gradient Compressors, by Yongchang Hao et al.
Flora: Low-Rank Adapters Are Secretly Gradient Compressorsby Yongchang Hao, Yanshuai Cao, Lili MouFirst submitted to…
Summary of Riemannian Preconditioned Lora For Fine-tuning Foundation Models, by Fangzhao Zhang et al.
Riemannian Preconditioned LoRA for Fine-Tuning Foundation Modelsby Fangzhao Zhang, Mert PilanciFirst submitted to arxiv on:…
Summary of A Framework to Implement 1+n Multi-task Fine-tuning Pattern in Llms Using the Cgc-lora Algorithm, by Chao Song and Zhihao Ye and Qiqiang Lin and Qiuying Peng and Jun Wang
A Framework to Implement 1+N Multi-task Fine-tuning Pattern in LLMs Using the CGC-LORA Algorithmby Chao…
Summary of Lotr: Low Tensor Rank Weight Adaptation, by Daniel Bershatsky et al.
LoTR: Low Tensor Rank Weight Adaptationby Daniel Bershatsky, Daria Cherniuk, Talgat Daulbaev, Aleksandr Mikhalev, Ivan…
Summary of Convolution Meets Lora: Parameter Efficient Finetuning For Segment Anything Model, by Zihan Zhong et al.
Convolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Modelby Zihan Zhong, Zhiqiang Tang, Tong…
Summary of Investigating Training Strategies and Model Robustness Of Low-rank Adaptation For Language Modeling in Speech Recognition, by Yu Yu et al.
Investigating Training Strategies and Model Robustness of Low-Rank Adaptation for Language Modeling in Speech Recognitionby…
Summary of Solving Continual Offline Reinforcement Learning with Decision Transformer, by Kaixin Huang et al.
Solving Continual Offline Reinforcement Learning with Decision Transformerby Kaixin Huang, Li Shen, Chen Zhao, Chun…