Summary of Lora-switch: Boosting the Efficiency Of Dynamic Llm Adapters Via System-algorithm Co-design, by Rui Kong et al.
LoRA-Switch: Boosting the Efficiency of Dynamic LLM Adapters via System-Algorithm Co-designby Rui Kong, Qiyang Li,…
Summary of Meteora: Multiple-tasks Embedded Lora For Large Language Models, by Jingwei Xu and Junyu Lai and Yunpeng Huang
MeteoRA: Multiple-tasks Embedded LoRA for Large Language Modelsby Jingwei Xu, Junyu Lai, Yunpeng HuangFirst submitted…
Summary of Uni-moe: Scaling Unified Multimodal Llms with Mixture Of Experts, by Yunxin Li et al.
Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Expertsby Yunxin Li, Shenyuan Jiang, Baotian Hu,…
Summary of Many Hands Make Light Work: Task-oriented Dialogue System with Module-based Mixture-of-experts, by Ruolin Su et al.
Many Hands Make Light Work: Task-Oriented Dialogue System with Module-Based Mixture-of-Expertsby Ruolin Su, Biing-Hwang JuangFirst…
Summary of Sutra: Scalable Multilingual Language Model Architecture, by Abhijit Bendale and Michael Sapienza and Steven Ripplinger and Simon Gibbs and Jaewon Lee and Pranav Mistry
SUTRA: Scalable Multilingual Language Model Architectureby Abhijit Bendale, Michael Sapienza, Steven Ripplinger, Simon Gibbs, Jaewon…
Summary of A Mixture-of-experts Approach to Few-shot Task Transfer in Open-ended Text Worlds, by Christopher Z. Cui et al.
A Mixture-of-Experts Approach to Few-Shot Task Transfer in Open-Ended Text Worldsby Christopher Z. Cui, Xiangyu…
Summary of Mix Of Experts Language Model For Named Entity Recognition, by Xinwei Chen et al.
Mix of Experts Language Model for Named Entity Recognitionby Xinwei Chen, Kun Li, Tianyou Song,…
Summary of Mmoe: Robust Spoiler Detection with Multi-modal Information and Domain-aware Mixture-of-experts, by Zinan Zeng et al.
MMoE: Robust Spoiler Detection with Multi-modal Information and Domain-aware Mixture-of-Expertsby Zinan Zeng, Sen Ye, Zijian…
Summary of Constitutionalexperts: Training a Mixture Of Principle-based Prompts, by Savvas Petridis et al.
ConstitutionalExperts: Training a Mixture of Principle-based Promptsby Savvas Petridis, Ben Wedin, Ann Yuan, James Wexler,…