Summary of Parameter-efficient Sparsity Crafting From Dense to Mixture-of-experts For Instruction Tuning on General Tasks, by Haoyuan Wu et al.
Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasksby Haoyuan Wu,…