Towards Adversarial Robustness of Model-Level Mixture-of-Experts Architectures for Semantic Segmentationby Svetlana Pavlitska, Enrico Eisen, J.…
Llama 3 Meets MoE: Efficient Upcyclingby Aditya Vavre, Ethan He, Dennis Liu, Zijie Yan, June…
Mixture of Experts Meets Decoupled Message Passing: Towards General and Adaptive Node Classificationby Xuanze Chen,…
MoE-CAP: Benchmarking Cost, Accuracy and Performance of Sparse Mixture-of-Experts Systemsby Yao Fu, Yinsicheng Jiang, Yeqi…
SAME: Learning Generic Language-Guided Visual Navigation with State-Adaptive Mixture of Expertsby Gengze Zhou, Yicong Hong,…
Convolutional Neural Networks and Mixture of Experts for Intrusion Detection in 5G Networks and beyondby…
Yi-Lightning Technical Reportby Alan Wake, Bei Chen, C.X. Lv, Chao Li, Chengen Huang, Chenglin Cai,…
HiMoE: Heterogeneity-Informed Mixture-of-Experts for Fair Spatial-Temporal Forecastingby Shaohan Yu, Pan Deng, Yu Zhao, Junting Liu,…
Mixture of Cache-Conditional Experts for Efficient Mobile Device Inferenceby Andrii Skliar, Ties van Rozendaal, Romain…
Condense, Don’t Just Prune: Enhancing Efficiency and Performance in MoE Layer Pruningby Mingyu Cao, Gen…