Navigating Spatio-Temporal Heterogeneity: A Graph Transformer Approach for Traffic Forecastingby Jianxiang Zhou, Erdong Liu, Wei…
HMoE: Heterogeneous Mixture of Experts for Language Modelingby An Wang, Xingwu Sun, Ruobing Xie, Shuaipeng…
AnyGraph: Graph Foundation Model in the Wildby Lianghao Xia, Chao HuangFirst submitted to arxiv on:…
AdapMoE: Adaptive Sensitivity-based Expert Gating and Management for Efficient MoE Inferenceby Shuzhang Zhong, Ling Liang,…
SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Modelsby Anke Tang, Li…
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Expertsby Qizhen Zhang,…
A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learningby Prateek…
Contrastive Learning and Mixture of Experts Enables Precise Vector Embeddingsby Logan Hallee, Rohan Kapur, Arjun…