Summary of Tpd: Enhancing Student Language Model Reasoning Via Principle Discovery and Guidance, by Haorui Wang (1) et al.
TPD: Enhancing Student Language Model Reasoning via Principle Discovery and Guidanceby Haorui Wang, Rongzhi Zhang,…
Summary of Dualteacher: Bridging Coexistence Of Unlabelled Classes For Semi-supervised Incremental Object Detection, by Ziqi Yuan et al.
DualTeacher: Bridging Coexistence of Unlabelled Classes for Semi-supervised Incremental Object Detectionby Ziqi Yuan, Liyuan Wang,…
Summary of On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process, by Gereziher Adhane and Mohammad Mahdi Dehshibi and Dennis Vetter and David Masip and Gemma Roig
On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Processby Gereziher Adhane, Mohammad Mahdi…
Summary of A Theoretical Analysis Of Soft-label Vs Hard-label Training in Neural Networks, by Saptarshi Mandal et al.
A Theoretical Analysis of Soft-Label vs Hard-Label Training in Neural Networksby Saptarshi Mandal, Xiaojun Lin,…
Summary of Reverse Thinking Makes Llms Stronger Reasoners, by Justin Chih-yao Chen et al.
Reverse Thinking Makes LLMs Stronger Reasonersby Justin Chih-Yao Chen, Zifeng Wang, Hamid Palangi, Rujun Han,…
Summary of Pre-training Graph Contrastive Masked Autoencoders Are Strong Distillers For Eeg, by Xinxu Wei et al.
Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEGby Xinxu Wei, Kanhao Zhao, Yong…
Summary of Adaptive Group Robust Ensemble Knowledge Distillation, by Patrik Kenfack et al.
Adaptive Group Robust Ensemble Knowledge Distillationby Patrik Kenfack, Ulrich Aïvodji, Samira Ebrahimi KahouFirst submitted to…
Summary of Quantifying Knowledge Distillation Using Partial Information Decomposition, by Pasan Dissanayake et al.
Quantifying Knowledge Distillation Using Partial Information Decompositionby Pasan Dissanayake, Faisal Hamman, Barproda Halder, Ilia Sucholutsky,…
Summary of Multi-level Feature Distillation Of Joint Teachers Trained on Distinct Image Datasets, by Adrian Iordache et al.
Multi-Level Feature Distillation of Joint Teachers Trained on Distinct Image Datasetsby Adrian Iordache, Bogdan Alexe,…
Summary of Knowledge Distillation Using Frontier Open-source Llms: Generalizability and the Role Of Synthetic Data, by Anup Shirgaonkar et al.
Knowledge Distillation Using Frontier Open-source LLMs: Generalizability and the Role of Synthetic Databy Anup Shirgaonkar,…