LoRA-SP: Streamlined Partial Parameter Adaptation for Resource-Efficient Fine-Tuning of Large Language Modelsby Yichao Wu, Yafei…
Unleashing the Power of Meta-tuning for Few-shot Generalization Through Sparse Interpolated Expertsby Shengzhuang Chen, Jihoon…
RIFF: Learning to Rephrase Inputs for Few-shot Fine-tuning of Language Modelsby Saeed Najafi, Alona FysheFirst…
Large Convolutional Model Tuning via Filter Subspaceby Wei Chen, Zichen Miao, Qiang QiuFirst submitted to…
DropBP: Accelerating Fine-Tuning of Large Language Models by Dropping Backward Propagationby Sunghyeon Woo, Baeseong Park,…
When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Methodby Biao Zhang,…
BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocationby Peng Xu, Wenqi Shao, Mengzhao…
Representing Online Handwriting for Recognition in Large Vision-Language Modelsby Anastasiia Fadeeva, Philippe Schlattner, Andrii Maksai,…
Advancing Parameter Efficiency in Fine-tuning via Representation Editingby Muling Wu, Wenhao Liu, Xiaohua Wang, Tianlong…
PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learningby Zhisheng Lin, Han Fu, Chenghao Liu,…