Synthetic Knowledge Ingestion: Towards Knowledge Refinement and Injection for Enhancing Large Language Modelsby Jiaxin Zhang,…
ALLoRA: Adaptive Learning Rate Mitigates LoRA Fatal Flawsby Hai Huang, Randall BalestrieroFirst submitted to arxiv…
MTL-LoRA: Low-Rank Adaptation for Multi-Task Learningby Yaming Yang, Dilxat Muhtar, Yelong Shen, Yuefeng Zhan, Jianfeng…
Toward Guidance-Free AR Visual Generation via Condition Contrastive Alignmentby Huayu Chen, Hang Su, Peize Sun,…
Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Modelsby Sathya Kamesh Bhethanabhotla, Omar Swelam,…
nach0-pc: Multi-task Language Model with Molecular Point Cloud Encoderby Maksim Kuznetsov, Airat Valiev, Alex Aliper,…
Parameter-Efficient Fine-Tuning via Selective Discrete Cosine Transformby Yixian Shen, Qi Bi, Jia-Hong Huang, Hongyi Zhu,…
Zeroth-Order Fine-Tuning of LLMs in Random Subspacesby Ziming Yu, Pan Zhou, Sike Wang, Jia Li,…
Parameter-Efficient Fine-Tuning of State Space Modelsby Kevin Galim, Wonjun Kang, Yuchen Zeng, Hyung Il Koo,…
BIPEFT: Budget-Guided Iterative Search for Parameter Efficient Fine-Tuning of Large Pretrained Language Modelsby Aofei Chang,…