Summary of Speculative Knowledge Distillation: Bridging the Teacher-student Gap Through Interleaved Sampling, by Wenda Xu et al.
Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Samplingby Wenda Xu, Rujun Han, Zifeng…