Summary of Dynamic Mixture Of Experts: An Auto-tuning Approach For Efficient Transformer Models, by Yongxin Guo et al.
Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Modelsby Yongxin Guo, Zhenglin Cheng,…
Summary of Mixture Of Experts Meets Prompt-based Continual Learning, by Minh Le et al.
Mixture of Experts Meets Prompt-Based Continual Learningby Minh Le, An Nguyen, Huy Nguyen, Trang Nguyen,…
Summary of Statistical Advantages Of Perturbing Cosine Router in Mixture Of Experts, by Huy Nguyen et al.
Statistical Advantages of Perturbing Cosine Router in Mixture of Expertsby Huy Nguyen, Pedram Akbarian, Trang…
Summary of Directmultistep: Direct Route Generation For Multi-step Retrosynthesis, by Yu Shee et al.
DirectMultiStep: Direct Route Generation for Multi-Step Retrosynthesisby Yu Shee, Haote Li, Anton Morgunov, Victor BatistaFirst…
Summary of Sigmoid Gating Is More Sample Efficient Than Softmax Gating in Mixture Of Experts, by Huy Nguyen et al.
Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Expertsby Huy Nguyen,…
Summary of Ensemble and Mixture-of-experts Deeponets For Operator Learning, by Ramansh Sharma et al.
Ensemble and Mixture-of-Experts DeepONets For Operator Learningby Ramansh Sharma, Varun ShankarFirst submitted to arxiv on:…
Summary of Learning More Generalized Experts by Merging Experts in Mixture-of-experts, By Sejik Park
Learning More Generalized Experts by Merging Experts in Mixture-of-Expertsby Sejik ParkFirst submitted to arxiv on:…
Summary of Lory: Fully Differentiable Mixture-of-experts For Autoregressive Language Model Pre-training, by Zexuan Zhong et al.
Lory: Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-trainingby Zexuan Zhong, Mengzhou Xia, Danqi Chen,…
Summary of Hierarchical Mixture Of Discriminative Generalized Dirichlet Classifiers, by Elvis Togban and Djemel Ziou
Hierarchical mixture of discriminative Generalized Dirichlet classifiersby Elvis Togban, Djemel ZiouFirst submitted to arxiv on:…
Summary of Mvmoe: Multi-task Vehicle Routing Solver with Mixture-of-experts, by Jianan Zhou et al.
MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertsby Jianan Zhou, Zhiguang Cao, Yaoxin Wu, Wen Song,…