Summary of Model-glue: Democratized Llm Scaling For a Large Model Zoo in the Wild, by Xinyu Zhao et al.
Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wildby Xinyu Zhao, Guoheng…
Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wildby Xinyu Zhao, Guoheng…
Multimodal Fusion Strategies for Mapping Biophysical Landscape Featuresby Lucia Gordon, Nico Lang, Catherine Ressijac, Andrew…
MLP-KAN: Unifying Deep Representation and Function Learningby Yunhong He, Yifeng Xie, Zhengqing Yuan, Lichao SunFirst…
On Expert Estimation in Hierarchical Mixture of Experts: Beyond Softmax Gating Functionsby Huy Nguyen, Xing…
EC-DIT: Scaling Diffusion Transformers with Adaptive Expert-Choice Routingby Haotian Sun, Tao Lei, Bowen Zhang, Yanghao…
Searching for Efficient Linear Layers over a Continuous Space of Structured Matricesby Andres Potapczynski, Shikai…
Open-RAG: Enhanced Retrieval-Augmented Reasoning with Open-Source Large Language Modelsby Shayekh Bin Islam, Md Asib Rahman,…
Upcycling Instruction Tuning from Dense to Mixture-of-Experts via Parameter Mergingby Tingfeng Hui, Zhenyu Zhang, Shuohuan…
The Labyrinth of Links: Navigating the Associative Maze of Multi-modal LLMsby Hong Li, Nanxi Li,…
Robust Traffic Forecasting against Spatial Shift over Yearsby Hongjun Wang, Jiyuan Chen, Tong Pan, Zheng…