Interpretable mixture of experts for time series prediction under recurrent and non-recurrent conditionsby Zemian Ke,…
OLMoE: Open Mixture-of-Experts Language Modelsby Niklas Muennighoff, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Jacob Morrison,…
Beyond Parameter Count: Implicit Bias in Soft Mixture of Expertsby Youngseog Chung, Dhruv Malik, Jeff…
Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Expertsby Lean Wang, Huazuo Gao, Chenggang Zhao, Xu Sun, Damai…
Advancing Enterprise Spatio-Temporal Forecasting Applications: Data Mining Meets Instruction Tuning of Language Models For Multi-modal…
Contrastive Learning and Mixture of Experts Enables Precise Vector Embeddingsby Logan Hallee, Rohan Kapur, Arjun…