Summary of Lolcats: on Low-rank Linearizing Of Large Language Models, by Michael Zhang et al.
LoLCATs: On Low-Rank Linearizing of Large Language Modelsby Michael Zhang, Simran Arora, Rahul Chalamala, Alan…
Summary of Retrieval Instead Of Fine-tuning: a Retrieval-based Parameter Ensemble For Zero-shot Learning, by Pengfei Jin et al.
Retrieval Instead of Fine-tuning: A Retrieval-based Parameter Ensemble for Zero-shot Learningby Pengfei Jin, Peng Shu,…
Summary of Am-sam: Automated Prompting and Mask Calibration For Segment Anything Model, by Yuchen Li et al.
AM-SAM: Automated Prompting and Mask Calibration for Segment Anything Modelby Yuchen Li, Li Zhang, Youwei…
Summary of Bidora: Bi-level Optimization-based Weight-decomposed Low-rank Adaptation, by Peijia Qin et al.
BiDoRA: Bi-level Optimization-Based Weight-Decomposed Low-Rank Adaptationby Peijia Qin, Ruiyi Zhang, Pengtao XieFirst submitted to arxiv…
Summary of Allora: Adaptive Learning Rate Mitigates Lora Fatal Flaws, by Hai Huang et al.
ALLoRA: Adaptive Learning Rate Mitigates LoRA Fatal Flawsby Hai Huang, Randall BalestrieroFirst submitted to arxiv…
Summary of Randomized Asymmetric Chain Of Lora: the First Meaningful Theoretical Framework For Low-rank Adaptation, by Grigory Malinovsky et al.
Randomized Asymmetric Chain of LoRA: The First Meaningful Theoretical Framework for Low-Rank Adaptationby Grigory Malinovsky,…
Summary of One Initialization to Rule Them All: Fine-tuning Via Explained Variance Adaptation, by Fabian Paischer et al.
One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptationby Fabian Paischer, Lukas Hauzenberger,…
Summary of Neutral Residues: Revisiting Adapters For Model Extension, by Franck Signe Talla and Herve Jegou and Edouard Grave
Neutral residues: revisiting adapters for model extensionby Franck Signe Talla, Herve Jegou, Edouard GraveFirst submitted…
Summary of Selective Aggregation For Low-rank Adaptation in Federated Learning, by Pengxin Guo et al.
Selective Aggregation for Low-Rank Adaptation in Federated Learningby Pengxin Guo, Shuang Zeng, Yanran Wang, Huijie…
Summary of Dlp-lora: Efficient Task-specific Lora Fusion with a Dynamic, Lightweight Plugin For Large Language Models, by Yuxuan Zhang et al.
DLP-LoRA: Efficient Task-Specific LoRA Fusion with a Dynamic, Lightweight Plugin for Large Language Modelsby Yuxuan…