Summary of High-dimensional Analysis Of Knowledge Distillation: Weak-to-strong Generalization and Scaling Laws, by M. Emrullah Ildiz et al.
High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Lawsby M. Emrullah Ildiz, Halil Alperen…