Summary of Parameter Efficient Instruction Tuning: An Empirical Study, by Pengfei He
Parameter Efficient Instruction Tuning: An Empirical Studyby Pengfei HeFirst submitted to arxiv on: 25 Nov…
Summary of Lora-mini : Adaptation Matrices Decomposition and Selective Training, by Ayush Singh et al.
LoRA-Mini : Adaptation Matrices Decomposition and Selective Trainingby Ayush Singh, Rajdeep Aher, Shivank GargFirst submitted…
Summary of Gradient Dynamics For Low-rank Fine-tuning Beyond Kernels, by Arif Kerem Dayi et al.
Gradient dynamics for low-rank fine-tuning beyond kernelsby Arif Kerem Dayi, Sitan ChenFirst submitted to arxiv…
Summary of Reassessing Layer Pruning in Llms: New Insights and Methods, by Yao Lu et al.
Reassessing Layer Pruning in LLMs: New Insights and Methodsby Yao Lu, Hao Cheng, Yujie Fang,…
Summary of Iteris: Iterative Inference-solving Alignment For Lora Merging, by Hongxu Chen et al.
IterIS: Iterative Inference-Solving Alignment for LoRA Mergingby Hongxu Chen, Runshi Li, Bowei Zhu, Zhen Wang,…
Summary of Lora-fair: Federated Lora Fine-tuning with Aggregation and Initialization Refinement, by Jieming Bian et al.
LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinementby Jieming Bian, Lei Wang, Letian Zhang,…
Summary of Lora Unlearns More and Retains More (student Abstract), by Atharv Mittal
LoRA Unlearns More and Retains More (Student Abstract)by Atharv MittalFirst submitted to arxiv on: 16…
Summary of Seqproft: Applying Lora Finetuning For Sequence-only Protein Property Predictions, by Shuo Zhang et al.
SeqProFT: Applying LoRA Finetuning for Sequence-only Protein Property Predictionsby Shuo Zhang, Jian K. LiuFirst submitted…
Summary of Dynamic Subset Tuning: Expanding the Operational Range Of Parameter-efficient Training For Large Language Models, by Felix Stahlberg et al.
Dynamic Subset Tuning: Expanding the Operational Range of Parameter-Efficient Training for Large Language Modelsby Felix…
Summary of Machine Unlearning on Pre-trained Models by Residual Feature Alignment Using Lora, By Laiqiao Qin et al.
Machine Unlearning on Pre-trained Models by Residual Feature Alignment Using LoRAby Laiqiao Qin, Tianqing Zhu,…