Summary of Revisiting Smoe Language Models by Evaluating Inefficiencies with Task Specific Expert Pruning, By Soumajyoti Sarkar et al.
Revisiting SMoE Language Models by Evaluating Inefficiencies with Task Specific Expert Pruningby Soumajyoti Sarkar, Leonard…