Summary of Shortened Llama: Depth Pruning For Large Language Models with Comparison Of Retraining Methods, by Bo-kyeong Kim et al.
Shortened LLaMA: Depth Pruning for Large Language Models with Comparison of Retraining Methodsby Bo-Kyeong Kim,…
Summary of Riemannian Preconditioned Lora For Fine-tuning Foundation Models, by Fangzhao Zhang et al.
Riemannian Preconditioned LoRA for Fine-Tuning Foundation Modelsby Fangzhao Zhang, Mert PilanciFirst submitted to arxiv on:…
Summary of From Peft to Deft: Parameter Efficient Finetuning For Reducing Activation Density in Transformers, by Bharat Runwal et al.
From PEFT to DEFT: Parameter Efficient Finetuning for Reducing Activation Density in Transformersby Bharat Runwal,…
Summary of A Framework to Implement 1+n Multi-task Fine-tuning Pattern in Llms Using the Cgc-lora Algorithm, by Chao Song and Zhihao Ye and Qiqiang Lin and Qiuying Peng and Jun Wang
A Framework to Implement 1+N Multi-task Fine-tuning Pattern in LLMs Using the CGC-LORA Algorithmby Chao…
Summary of Lotr: Low Tensor Rank Weight Adaptation, by Daniel Bershatsky et al.
LoTR: Low Tensor Rank Weight Adaptationby Daniel Bershatsky, Daria Cherniuk, Talgat Daulbaev, Aleksandr Mikhalev, Ivan…
Summary of Convolution Meets Lora: Parameter Efficient Finetuning For Segment Anything Model, by Zihan Zhong et al.
Convolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Modelby Zihan Zhong, Zhiqiang Tang, Tong…
Summary of Improving Reinforcement Learning From Human Feedback with Efficient Reward Model Ensemble, by Shun Zhang et al.
Improving Reinforcement Learning from Human Feedback with Efficient Reward Model Ensembleby Shun Zhang, Zhenfang Chen,…
Summary of True Knowledge Comes From Practice: Aligning Llms with Embodied Environments Via Reinforcement Learning, by Weihao Tan et al.
True Knowledge Comes from Practice: Aligning LLMs with Embodied Environments via Reinforcement Learningby Weihao Tan,…
Summary of Investigating Training Strategies and Model Robustness Of Low-rank Adaptation For Language Modeling in Speech Recognition, by Yu Yu et al.
Investigating Training Strategies and Model Robustness of Low-Rank Adaptation for Language Modeling in Speech Recognitionby…
Summary of A Fast, Performant, Secure Distributed Training Framework For Large Language Model, by Wei Huang et al.
A Fast, Performant, Secure Distributed Training Framework For Large Language Modelby Wei Huang, Yinggui Wang,…