Summary of Towards Infinite-long Prefix in Transformer, by Yingyu Liang et al.
Towards Infinite-Long Prefix in Transformerby Yingyu Liang, Zhenmei Shi, Zhao Song, Chiwun YangFirst submitted to…
Summary of Can Low-rank Knowledge Distillation in Llms Be Useful For Microelectronic Reasoning?, by Nirjhor Rouf et al.
Can Low-Rank Knowledge Distillation in LLMs be Useful for Microelectronic Reasoning?by Nirjhor Rouf, Fin Amin,…
Summary of Sparse High Rank Adapters, by Kartikeya Bhardwaj et al.
Sparse High Rank Adaptersby Kartikeya Bhardwaj, Nilesh Prasad Pandey, Sweta Priyadarshi, Viswanath Ganapathy, Shreya Kadambi,…
Summary of Lamda: Large Model Fine-tuning Via Spectrally Decomposed Low-dimensional Adaptation, by Seyedarmin Azizi et al.
LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptationby Seyedarmin Azizi, Souvik Kundu, Massoud PedramFirst…
Summary of Virl: Volume-informed Representation Learning Towards Few-shot Manufacturability Estimation, by Yu-hsuan Chen et al.
VIRL: Volume-Informed Representation Learning towards Few-shot Manufacturability Estimationby Yu-hsuan Chen, Jonathan Cagan, Levent Burak karaFirst…
Summary of Mixture-of-subspaces in Low-rank Adaptation, by Taiqiang Wu et al.
Mixture-of-Subspaces in Low-Rank Adaptationby Taiqiang Wu, Jiahao Wang, Zhe Zhao, Ngai WongFirst submitted to arxiv…
Summary of Promoting Data and Model Privacy in Federated Learning Through Quantized Lora, by Jianhao Zhu et al.
Promoting Data and Model Privacy in Federated Learning through Quantized LoRAby JianHao Zhu, Changze Lv,…
Summary of Vertical Lora: Dense Expectation-maximization Interpretation Of Transformers, by Zhuolin Fu
Vertical LoRA: Dense Expectation-Maximization Interpretation of Transformersby Zhuolin FuFirst submitted to arxiv on: 13 Jun…
Summary of The Impact Of Initialization on Lora Finetuning Dynamics, by Soufiane Hayou et al.
The Impact of Initialization on LoRA Finetuning Dynamicsby Soufiane Hayou, Nikhil Ghosh, Bin YuFirst submitted…
Summary of Switchlora: Switched Low-rank Adaptation Can Learn Full-rank Information, by Kaiye Zhou et al.
SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Informationby Kaiye Zhou, Shucheng Wang, Jun XuFirst submitted…