Summary of The Unreasonable Ineffectiveness Of the Deeper Layers, by Andrey Gromov et al.
The Unreasonable Ineffectiveness of the Deeper Layersby Andrey Gromov, Kushal Tirumala, Hassan Shapourian, Paolo Glorioso,…
The Unreasonable Ineffectiveness of the Deeper Layersby Andrey Gromov, Kushal Tirumala, Hassan Shapourian, Paolo Glorioso,…
A Single Linear Layer Yields Task-Adapted Low-Rank Matricesby Hwichan Kim, Shota Sasaki, Sho Hoshino, Ukyo…
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveyby Zeyu Han, Chao Gao, Jinyang Liu, Jeff…
AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Modelsby Zeyu…
AdaFish: Fast low-rank parameter-efficient fine-tuning by using second-order informationby Jiang Hu, Quanzheng LiFirst submitted to…
ADAPT to Robustify Prompt Tuning Vision Transformersby Masih Eskandar, Tooba Imtiaz, Zifeng Wang, Jennifer DyFirst…
FinLlama: Financial Sentiment Classification for Algorithmic Trading Applicationsby Thanos Konstantinidis, Giorgos Iacovides, Mingxue Xu, Tony…
Improving LoRA in Privacy-preserving Federated Learningby Youbang Sun, Zitao Li, Yaliang Li, Bolin DingFirst submitted…
Parameter Efficient Reinforcement Learning from Human Feedbackby Hakim Sidahmed, Samrat Phatale, Alex Hutcheson, Zhuonan Lin,…
Shake to Leak: Fine-tuning Diffusion Models Can Amplify the Generative Privacy Riskby Zhangheng Li, Junyuan…