Summary of Sinkhorn Distance Minimization For Knowledge Distillation, by Xiao Cui et al.
Sinkhorn Distance Minimization for Knowledge Distillationby Xiao Cui, Yulei Qin, Yuting Gao, Enwei Zhang, Zihan…
Summary of M2mkd: Module-to-module Knowledge Distillation For Modular Transformers, by Ka Man Lo et al.
m2mKD: Module-to-Module Knowledge Distillation for Modular Transformersby Ka Man Lo, Yiming Liang, Wenyu Du, Yuantao…
Summary of Practical Insights Into Knowledge Distillation For Pre-trained Models, by Norah Alballa and Marco Canini
Practical Insights into Knowledge Distillation for Pre-Trained Modelsby Norah Alballa, Marco CaniniFirst submitted to arxiv…
Summary of Wisdom Of Committee: Distilling From Foundation Model to Specialized Application Model, by Zichang Liu et al.
Wisdom of Committee: Distilling from Foundation Model to Specialized Application Modelby Zichang Liu, Qingyun Liu,…
Summary of On the Byzantine-resilience Of Distillation-based Federated Learning, by Christophe Roux et al.
On the Byzantine-Resilience of Distillation-Based Federated Learningby Christophe Roux, Max Zimmer, Sebastian PokuttaFirst submitted to…
Summary of Teacher As a Lenient Expert: Teacher-agnostic Data-free Knowledge Distillation, by Hyunjune Shin et al.
Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillationby Hyunjune Shin, Dong-Wan ChoiFirst submitted to…
Summary of Graphkd: Exploring Knowledge Distillation Towards Document Object Detection with Structured Graph Creation, by Ayan Banerjee et al.
GraphKD: Exploring Knowledge Distillation Towards Document Object Detection with Structured Graph Creationby Ayan Banerjee, Sanket…
Summary of Knowledge Distillation Based on Transformed Teacher Matching, by Kaixiang Zheng and En-hui Yang
Knowledge Distillation Based on Transformed Teacher Matchingby Kaixiang Zheng, En-Hui YangFirst submitted to arxiv on:…
Summary of Fedd2s: Personalized Data-free Federated Knowledge Distillation, by Kawa Atapour et al.
FedD2S: Personalized Data-Free Federated Knowledge Distillationby Kawa Atapour, S. Jamal Seyedmohammadi, Jamshid Abouei, Arash Mohammadi,…
Summary of Incremental Sequence Labeling: a Tale Of Two Shifts, by Shengjie Qiu et al.
Incremental Sequence Labeling: A Tale of Two Shiftsby Shengjie Qiu, Junhao Zheng, Zhen Liu, Yicheng…