Summary of Contrastive Learning and Mixture Of Experts Enables Precise Vector Embeddings, by Logan Hallee et al.
Contrastive Learning and Mixture of Experts Enables Precise Vector Embeddingsby Logan Hallee, Rohan Kapur, Arjun…
Summary of Is Temperature Sample Efficient For Softmax Gaussian Mixture Of Experts?, by Huy Nguyen et al.
Is Temperature Sample Efficient for Softmax Gaussian Mixture of Experts?by Huy Nguyen, Pedram Akbarian, Nhat…
Summary of Exploiting Inter-layer Expert Affinity For Accelerating Mixture-of-experts Model Inference, by Jinghan Yao et al.
Exploiting Inter-Layer Expert Affinity for Accelerating Mixture-of-Experts Model Inferenceby Jinghan Yao, Quentin Anthony, Aamir Shafi,…
Summary of Robust Calibration For Improved Weather Prediction Under Distributional Shift, by Sankalp Gilda et al.
Robust Calibration For Improved Weather Prediction Under Distributional Shiftby Sankalp Gilda, Neel Bhandari, Wendy Mak,…
Summary of Mixtral Of Experts, by Albert Q. Jiang et al.
Mixtral of Expertsby Albert Q. Jiang, Alexandre Sablayrolles, Antoine Roux, Arthur Mensch, Blanche Savary, Chris…