Summary of Lisa: Layerwise Importance Sampling For Memory-efficient Large Language Model Fine-tuning, by Rui Pan et al.
LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuningby Rui Pan, Xiang Liu, Shizhe…
Summary of A Single Linear Layer Yields Task-adapted Low-rank Matrices, by Hwichan Kim et al.
A Single Linear Layer Yields Task-Adapted Low-Rank Matricesby Hwichan Kim, Shota Sasaki, Sho Hoshino, Ukyo…
Summary of Improving Lora in Privacy-preserving Federated Learning, by Youbang Sun et al.
Improving LoRA in Privacy-preserving Federated Learningby Youbang Sun, Zitao Li, Yaliang Li, Bolin DingFirst submitted…
Summary of Autolora: Automatically Tuning Matrix Ranks in Low-rank Adaptation Based on Meta Learning, by Ruiyi Zhang et al.
AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learningby Ruiyi Zhang, Rushi…
Summary of Asymmetry in Low-rank Adapters Of Foundation Models, by Jiacheng Zhu et al.
Asymmetry in Low-Rank Adapters of Foundation Modelsby Jiacheng Zhu, Kristjan Greenewald, Kimia Nadjahi, Haitz Sáez…
Summary of Prolora: Partial Rotation Empowers More Parameter-efficient Lora, by Sheng Wang et al.
PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRAby Sheng Wang, Boyang Xue, Jiacheng Ye, Jiyue Jiang,…
Summary of Colora: Continuous Low-rank Adaptation For Reduced Implicit Neural Modeling Of Parameterized Partial Differential Equations, by Jules Berman and Benjamin Peherstorfer
CoLoRA: Continuous low-rank adaptation for reduced implicit neural modeling of parameterized partial differential equationsby Jules…
Summary of Lora+: Efficient Low Rank Adaptation Of Large Models, by Soufiane Hayou et al.
LoRA+: Efficient Low Rank Adaptation of Large Modelsby Soufiane Hayou, Nikhil Ghosh, Bin YuFirst submitted…
Summary of Uncertainty Quantification in Fine-tuned Llms Using Lora Ensembles, by Oleksandr Balabanov et al.
Uncertainty quantification in fine-tuned LLMs using LoRA ensemblesby Oleksandr Balabanov, Hampus LinanderFirst submitted to arxiv…
Summary of Privacy-preserving Low-rank Adaptation Against Membership Inference Attacks For Latent Diffusion Models, by Zihao Luo et al.
Privacy-Preserving Low-Rank Adaptation against Membership Inference Attacks for Latent Diffusion Modelsby Zihao Luo, Xilie Xu,…