Summary of Understanding Expert Structures on Minimax Parameter Estimation in Contaminated Mixture Of Experts, by Fanqi Yan et al.
Understanding Expert Structures on Minimax Parameter Estimation in Contaminated Mixture of Expertsby Fanqi Yan, Huy…
Summary of Moe-pruner: Pruning Mixture-of-experts Large Language Model Using the Hints From Its Router, by Yanyue Xie et al.
MoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Routerby Yanyue Xie, Zhi…
Summary of Moh: Multi-head Attention As Mixture-of-head Attention, by Peng Jin et al.
MoH: Multi-Head Attention as Mixture-of-Head Attentionby Peng Jin, Bo Zhu, Li Yuan, Shuicheng YanFirst submitted…
Summary of At-moe: Adaptive Task-planning Mixture Of Experts Via Lora Approach, by Xurui Li et al.
AT-MoE: Adaptive Task-planning Mixture of Experts via LoRA Approachby Xurui Li, Juanjuan YaoFirst submitted to…
Summary of Moirai-moe: Empowering Time Series Foundation Models with Sparse Mixture Of Experts, by Xu Liu et al.
Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertsby Xu Liu, Juncheng Liu,…
Summary of Mixture Of Experts Made Personalized: Federated Prompt Learning For Vision-language Models, by Jun Luo et al.
Mixture of Experts Made Personalized: Federated Prompt Learning for Vision-Language Modelsby Jun Luo, Chen Chen,…
Summary of Contextwin: Whittle Index Based Mixture-of-experts Neural Model For Restless Bandits Via Deep Rl, by Zhanqiu Guo et al.
ContextWIN: Whittle Index Based Mixture-of-Experts Neural Model For Restless Bandits Via Deep RLby Zhanqiu Guo,…
Summary of Moin: Mixture Of Introvert Experts to Upcycle An Llm, by Ajinkya Tejankar et al.
MoIN: Mixture of Introvert Experts to Upcycle an LLMby Ajinkya Tejankar, KL Navaneet, Ujjawal Panchal,…
Summary of Gets: Ensemble Temperature Scaling For Calibration in Graph Neural Networks, by Dingyi Zhuang et al.
GETS: Ensemble Temperature Scaling for Calibration in Graph Neural Networksby Dingyi Zhuang, Chonghe Jiang, Yunhan…
Summary of Retraining-free Merging Of Sparse Moe Via Hierarchical Clustering, by I-chun Chen et al.
Retraining-Free Merging of Sparse MoE via Hierarchical Clusteringby I-Chun Chen, Hsu-Shen Liu, Wei-Fang Sun, Chen-Hao…