Summary of Sbora: Low-rank Adaptation with Regional Weight Updates, by Lai-man Po et al.
SBoRA: Low-Rank Adaptation with Regional Weight Updatesby Lai-Man Po, Yuyang Liu, Haoxuan Wu, Tianqi Zhang,…
Summary of Lora-ga: Low-rank Adaptation with Gradient Approximation, by Shaowen Wang et al.
LoRA-GA: Low-Rank Adaptation with Gradient Approximationby Shaowen Wang, Linxi Yu, Jian LiFirst submitted to arxiv…
Summary of Gpt Vs Retro: Exploring the Intersection Of Retrieval and Parameter-efficient Fine-tuning, by Aleksander Ficek et al.
GPT vs RETRO: Exploring the Intersection of Retrieval and Parameter-Efficient Fine-Tuningby Aleksander Ficek, Jiaqi Zeng,…
Summary of Lora-guard: Parameter-efficient Guardrail Adaptation For Content Moderation Of Large Language Models, by Hayder Elesedy et al.
LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Modelsby Hayder Elesedy, Pedro M.…
Summary of Structured Unrestricted-rank Matrices For Parameter Efficient Fine-tuning, by Arijit Sehanobish et al.
Structured Unrestricted-Rank Matrices for Parameter Efficient Fine-tuningby Arijit Sehanobish, Avinava Dubey, Krzysztof Choromanski, Somnath Basu…
Summary of A Comprehensive Solution to Connect Speech Encoder and Large Language Model For Asr, by Van Tung Pham et al.
A Comprehensive Solution to Connect Speech Encoder and Large Language Model for ASRby Van Tung…
Summary of Blockllm: Memory-efficient Adaptation Of Llms by Selecting and Optimizing the Right Coordinate Blocks, By Amrutha Varshini Ramesh et al.
BlockLLM: Memory-Efficient Adaptation of LLMs by Selecting and Optimizing the Right Coordinate Blocksby Amrutha Varshini…
Summary of Retrieval-augmented Mixture Of Lora Experts For Uploadable Machine Learning, by Ziyu Zhao et al.
Retrieval-Augmented Mixture of LoRA Experts for Uploadable Machine Learningby Ziyu Zhao, Leilei Gan, Guoyin Wang,…
Summary of Unlocking the Global Synergies in Low-rank Adapters, by Zixi Zhang et al.
Unlocking the Global Synergies in Low-Rank Adaptersby Zixi Zhang, Cheng Zhang, Xitong Gao, Robert D.…
Summary of Flocora: Federated Learning Compression with Low-rank Adaptation, by Lucas Grativol Ribeiro et al.
FLoCoRA: Federated learning compression with low-rank adaptationby Lucas Grativol Ribeiro, Mathieu Leonardon, Guillaume Muller, Virginie…