Summary of Llmbind: a Unified Modality-task Integration Framework, by Bin Zhu et al.
LLMBind: A Unified Modality-Task Integration Frameworkby Bin Zhu, Munan Ning, Peng Jin, Bin Lin, Jinfa…
Summary of Moral: Moe Augmented Lora For Llms’ Lifelong Learning, by Shu Yang et al.
MoRAL: MoE Augmented LoRA for LLMs’ Lifelong Learningby Shu Yang, Muhammad Asif Ali, Cheng-Long Wang,…
Summary of Higher Layers Need More Lora Experts, by Chongyang Gao and Kezhen Chen and Jinmeng Rao and Baochen Sun and Ruibo Liu and Daiyi Peng and Yawen Zhang and Xiaoyuan Guo and Jie Yang and Vs Subrahmanian
Higher Layers Need More LoRA Expertsby Chongyang Gao, Kezhen Chen, Jinmeng Rao, Baochen Sun, Ruibo…
Summary of Parameter-efficient Sparsity Crafting From Dense to Mixture-of-experts For Instruction Tuning on General Tasks, by Haoyuan Wu et al.
Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasksby Haoyuan Wu,…
Summary of Multimodal Variational Autoencoder: a Barycentric View, by Peijie Qiu et al.
Multimodal Variational Autoencoder: a Barycentric Viewby Peijie Qiu, Wenhui Zhu, Sayantan Kumar, Xiwen Chen, Xiaotong…
Summary of Graph Mixture Of Experts and Memory-augmented Routers For Multivariate Time Series Anomaly Detection, by Xiaoyu Huang et al.
Graph Mixture of Experts and Memory-augmented Routers for Multivariate Time Series Anomaly Detectionby Xiaoyu Huang,…
Summary of Theory Of Mixture-of-experts For Mobile Edge Computing, by Hongbo Li and Lingjie Duan
Theory of Mixture-of-Experts for Mobile Edge Computingby Hongbo Li, Lingjie DuanFirst submitted to arxiv on:…
Summary of Remoe: Fully Differentiable Mixture-of-experts with Relu Routing, by Ziteng Wang et al.
ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routingby Ziteng Wang, Jun Zhu, Jianfei ChenFirst submitted to…
Summary of A Survey on Inference Optimization Techniques For Mixture Of Experts Models, by Jiacheng Liu et al.
A Survey on Inference Optimization Techniques for Mixture of Experts Modelsby Jiacheng Liu, Peng Tang,…
Summary of Wonderful Matrices: Combining For a More Efficient and Effective Foundation Model Architecture, by Jingze Shi and Bingheng Wu
Wonderful Matrices: Combining for a More Efficient and Effective Foundation Model Architectureby Jingze Shi, Bingheng…