On Expert Estimation in Hierarchical Mixture of Experts: Beyond Softmax Gating Functionsby Huy Nguyen, Xing…
EC-DIT: Scaling Diffusion Transformers with Adaptive Expert-Choice Routingby Haotian Sun, Tao Lei, Bowen Zhang, Yanghao…
Searching for Efficient Linear Layers over a Continuous Space of Structured Matricesby Andres Potapczynski, Shikai…
Open-RAG: Enhanced Retrieval-Augmented Reasoning with Open-Source Large Language Modelsby Shayekh Bin Islam, Md Asib Rahman,…
Upcycling Instruction Tuning from Dense to Mixture-of-Experts via Parameter Mergingby Tingfeng Hui, Zhenyu Zhang, Shuohuan…
The Labyrinth of Links: Navigating the Associative Maze of Multi-modal LLMsby Hong Li, Nanxi Li,…
UniAdapt: A Universal Adapter for Knowledge Calibrationby Tai D. Nguyen, Long H. Pham, Jun SunFirst…
Robust Traffic Forecasting against Spatial Shift over Yearsby Hongjun Wang, Jiyuan Chen, Tong Pan, Zheng…
MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuningby Haotian Zhang, Mingfei Gao, Zhe Gan,…
Uni-Med: A Unified Medical Generalist Foundation Model For Multi-Task Learning Via Connector-MoEby Xun Zhu, Ying…