Summary of A Provably Effective Method For Pruning Experts in Fine-tuned Sparse Mixture-of-experts, by Mohammed Nowaz Rabbani Chowdhury et al.
A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Expertsby Mohammed Nowaz Rabbani Chowdhury,…