Summary of More Fine-tuning with 10x Fewer Parameters, by Wenxuan Tan et al.
MoRe Fine-Tuning with 10x Fewer Parametersby Wenxuan Tan, Nicholas Roberts, Tzu-Heng Huang, Jitian Zhao, John…
Summary of Sorsa: Singular Values and Orthonormal Regularized Singular Vectors Adaptation Of Large Language Models, by Yang Cao
SORSA: Singular Values and Orthonormal Regularized Singular Vectors Adaptation of Large Language Modelsby Yang CaoFirst…
Summary of Instant Adversarial Purification with Adversarial Consistency Distillation, by Chun Tong Lei et al.
Instant Adversarial Purification with Adversarial Consistency Distillationby Chun Tong Lei, Hon Ming Yam, Zhongliang Guo,…
Summary of Curlora: Stable Llm Continual Fine-tuning and Catastrophic Forgetting Mitigation, by Muhammad Fawi
CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigationby Muhammad FawiFirst submitted to arxiv on:…
Summary of Reprogramming Foundational Large Language Models(llms) For Enterprise Adoption For Spatio-temporal Forecasting Applications: Unveiling a New Era in Copilot-guided Cross-modal Time Series Representation Learning, by Sakhinana Sagar Srinivas et al.
Reprogramming Foundational Large Language Models(LLMs) for Enterprise Adoption for Spatio-Temporal Forecasting Applications: Unveiling a New…
Summary of The Ultimate Guide to Fine-tuning Llms From Basics to Breakthroughs: An Exhaustive Review Of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities, by Venkatesh Balavadhani Parthasarathy et al.
The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies,…
Summary of Nora: Nested Low-rank Adaptation For Efficient Fine-tuning Large Models, by Cheng Lin et al.
NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Modelsby Cheng Lin, Lujun Li, Dezhi Li,…
Summary of Smile: Zero-shot Sparse Mixture Of Low-rank Experts Construction From Pre-trained Foundation Models, by Anke Tang et al.
SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Modelsby Anke Tang, Li…
Summary of Rbla: Rank-based-lora-aggregation For Fine-tuning Heterogeneous Models in Flaas, by Shuaijun Chen et al.
RBLA: Rank-Based-LoRA-Aggregation for Fine-tuning Heterogeneous Models in FLaaSby Shuaijun Chen, Omid Tavallaie, Niousha Nazemi, Albert…
Summary of Towards Robust and Parameter-efficient Knowledge Unlearning For Llms, by Sungmin Cha et al.
Towards Robust and Parameter-Efficient Knowledge Unlearning for LLMsby Sungmin Cha, Sungjun Cho, Dasol Hwang, Moontae…