Summary of Time-moe: Billion-scale Time Series Foundation Models with Mixture Of Experts, by Xiaoming Shi et al.
Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertsby Xiaoming Shi, Shiyu Wang, Yuqi…
Summary of A Gated Residual Kolmogorov-arnold Networks For Mixtures Of Experts, by Hugo Inzirillo and Remi Genet
A Gated Residual Kolmogorov-Arnold Networks for Mixtures of Expertsby Hugo Inzirillo, Remi GenetFirst submitted to…
Summary of On-device Collaborative Language Modeling Via a Mixture Of Generalists and Specialists, by Dongyang Fan et al.
On-Device Collaborative Language Modeling via a Mixture of Generalists and Specialistsby Dongyang Fan, Bettina Messmer,…
Summary of Grin: Gradient-informed Moe, by Liyuan Liu et al.
GRIN: GRadient-INformed MoEby Liyuan Liu, Young Jin Kim, Shuohang Wang, Chen Liang, Yelong Shen, Hao…
Summary of Mixture Of Diverse Size Experts, by Manxi Sun et al.
Mixture of Diverse Size Expertsby Manxi Sun, Wei Liu, Jian Luan, Pengzhi Gao, Bin WangFirst…
Summary of Lola — An Open-source Massively Multilingual Large Language Model, by Nikit Srivastava et al.
LOLA – An Open-Source Massively Multilingual Large Language Modelby Nikit Srivastava, Denis Kuchelev, Tatiana Moteu…
Summary of Da-moe: Towards Dynamic Expert Allocation For Mixture-of-experts Models, by Maryam Akhavan Aghdam et al.
DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Modelsby Maryam Akhavan Aghdam, Hongpeng Jin, Yanzhao WuFirst…
Summary of Stun: Structured-then-unstructured Pruning For Scalable Moe Pruning, by Jaeseong Lee et al.
STUN: Structured-Then-Unstructured Pruning for Scalable MoE Pruningby Jaeseong Lee, seung-won hwang, Aurick Qiao, Daniel F…
Summary of Ve: Modeling Multivariate Time Series Correlation with Variate Embedding, by Shangjiong Wang et al.
VE: Modeling Multivariate Time Series Correlation with Variate Embeddingby Shangjiong Wang, Zhihong Man, Zhenwei Cao,…
Summary of Alt-moe:a Scalable Framework For Bidirectional Multimodal Alignment and Efficient Knowledge Integration, by Hongyang Lei et al.
Alt-MoE:A Scalable Framework for Bidirectional Multimodal Alignment and Efficient Knowledge Integrationby Hongyang Lei, Xiaolong Cheng,…