Summary of Fusemoe: Mixture-of-experts Transformers For Fleximodal Fusion, by Xing Han et al.
FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusionby Xing Han, Huy Nguyen, Carl Harris, Nhat Ho, Suchi…
Summary of Interpretcc: Intrinsic User-centric Interpretability Through Global Mixture Of Experts, by Vinitra Swamy et al.
InterpretCC: Intrinsic User-Centric Interpretability through Global Mixture of Expertsby Vinitra Swamy, Syrielle Montariol, Julian Blackwell,…
Summary of On Least Square Estimation in Softmax Gating Mixture Of Experts, by Huy Nguyen and Nhat Ho and Alessandro Rinaldo
On Least Square Estimation in Softmax Gating Mixture of Expertsby Huy Nguyen, Nhat Ho, Alessandro…
Summary of Competesmoe — Effective Training Of Sparse Mixture Of Experts Via Competition, by Quang Pham et al.
CompeteSMoE – Effective Training of Sparse Mixture of Experts via Competitionby Quang Pham, Giang Do,…
Summary of Openmoe: An Early Effort on Open Mixture-of-experts Language Models, by Fuzhao Xue et al.
OpenMoE: An Early Effort on Open Mixture-of-Experts Language Modelsby Fuzhao Xue, Zian Zheng, Yao Fu,…
Summary of Mode: a Mixture-of-experts Model with Mutual Distillation Among the Experts, by Zhitian Xie et al.
MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Expertsby Zhitian Xie, Yinger Zhang, Chenyi…
Summary of Merging Multi-task Models Via Weight-ensembling Mixture Of Experts, by Anke Tang et al.
Merging Multi-Task Models via Weight-Ensembling Mixture of Expertsby Anke Tang, Li Shen, Yong Luo, Nan…
Summary of Explainable Data-driven Modeling Via Mixture Of Experts: Towards Effective Blending Of Grey and Black-box Models, by Jessica Leoni et al.
Explainable data-driven modeling via mixture of experts: towards effective blending of grey and black-box modelsby…
Summary of Checkmating One, by Using Many: Combining Mixture Of Experts with Mcts to Improve in Chess, By Felix Helfenstein et al.
Checkmating One, by Using Many: Combining Mixture of Experts with MCTS to Improve in Chessby…
Summary of Routers in Vision Mixture Of Experts: An Empirical Study, by Tianlin Liu et al.
Routers in Vision Mixture of Experts: An Empirical Studyby Tianlin Liu, Mathieu Blondel, Carlos Riquelme,…