PETAH: Parameter Efficient Task Adaptation for Hybrid Transformers in a resource-limited Contextby Maximilian Augustin, Syed…
Towards Optimal Adapter Placement for Efficient Transfer Learningby Aleksandra I. Nowak, Otniel-Bogdan Mercea, Anurag Arnab,…
MIRA: A Method of Federated MultI-Task Learning for LaRge LAnguage Modelsby Ahmed Elbakary, Chaouki Ben…
HiPPO-KAN: Efficient KAN Model for Time Series Analysisby SangJong Lee, Jin-Kwang Kim, JunHo Kim, TaeHan…
Parameter-efficient Adaptation of Multilingual Multimodal Models for Low-resource ASRby Abhishek Gupta, Amruta Parulekar, Sameep Chattopadhyay,…
LoKO: Low-Rank Kalman Optimizer for Online Fine-Tuning of Large Modelsby Hossein Abdi, Mingfei Sun, Andi…
ATLAS: Adapter-Based Multi-Modal Continual Learning with a Two-Stage Learning Strategyby Hong Li, Zhiquan Tan, Xingyu…
BiDoRA: Bi-level Optimization-Based Weight-Decomposed Low-Rank Adaptationby Peijia Qin, Ruiyi Zhang, Pengtao XieFirst submitted to arxiv…
MTL-LoRA: Low-Rank Adaptation for Multi-Task Learningby Yaming Yang, Dilxat Muhtar, Yelong Shen, Yuefeng Zhan, Jianfeng…
BIPEFT: Budget-Guided Iterative Search for Parameter Efficient Fine-Tuning of Large Pretrained Language Modelsby Aofei Chang,…