Summary of Lisa: Layerwise Importance Sampling For Memory-efficient Large Language Model Fine-tuning, by Rui Pan et al.
LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuningby Rui Pan, Xiang Liu, Shizhe…
Summary of A Unified Module For Accelerating Stable-diffusion: Lcm-lora, by Ayush Thakur and Rashmi Vashisth
A Unified Module for Accelerating STABLE-DIFFUSION: LCM-LORAby Ayush Thakur, Rashmi VashisthFirst submitted to arxiv on:…
Summary of A Three-phases Sft Hybrid Model Integrated Strong Prior Module and Data Overlap Estimation in the Eduation Context, by Zhangquan Chen et al.
A Three-Phases SFT Hybrid Model Integrated Strong Prior Module and Data Overlap Estimation in the…
Summary of A Single Linear Layer Yields Task-adapted Low-rank Matrices, by Hwichan Kim et al.
A Single Linear Layer Yields Task-Adapted Low-Rank Matricesby Hwichan Kim, Shota Sasaki, Sho Hoshino, Ukyo…
Summary of Knowla: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptation, by Xindi Luo and Zequn Sun and Jing Zhao and Zhe Zhao and Wei Hu
KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptationby Xindi Luo, Zequn Sun, Jing Zhao, Zhe Zhao,…
Summary of Aflora: Adaptive Freezing Of Low Rank Adaptation in Parameter Efficient Fine-tuning Of Large Models, by Zeyu Liu et al.
AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Modelsby Zeyu…
Summary of Bilora: a Bi-level Optimization Framework For Overfitting-resilient Low-rank Adaptation Of Large Pre-trained Models, by Rushi Qiang et al.
BiLoRA: A Bi-level Optimization Framework for Overfitting-Resilient Low-Rank Adaptation of Large Pre-trained Modelsby Rushi Qiang,…
Summary of Finllama: Financial Sentiment Classification For Algorithmic Trading Applications, by Thanos Konstantinidis et al.
FinLlama: Financial Sentiment Classification for Algorithmic Trading Applicationsby Thanos Konstantinidis, Giorgos Iacovides, Mingxue Xu, Tony…
Summary of Improving Lora in Privacy-preserving Federated Learning, by Youbang Sun et al.
Improving LoRA in Privacy-preserving Federated Learningby Youbang Sun, Zitao Li, Yaliang Li, Bolin DingFirst submitted…
Summary of Superlora: Parameter-efficient Unified Adaptation Of Multi-layer Attention Modules, by Xiangyu Chen et al.
SuperLoRA: Parameter-Efficient Unified Adaptation of Multi-Layer Attention Modulesby Xiangyu Chen, Jing Liu, Ye Wang, Pu…