Summary of Small Models Are Llm Knowledge Triggers on Medical Tabular Prediction, by Jiahuan Yan et al.
Small Models are LLM Knowledge Triggers on Medical Tabular Predictionby Jiahuan Yan, Jintai Chen, Chaowen…
Summary of Differentially Private Knowledge Distillation Via Synthetic Text Generation, by James Flemings and Murali Annavaram
Differentially Private Knowledge Distillation via Synthetic Text Generationby James Flemings, Murali AnnavaramFirst submitted to arxiv…
Summary of Teacher-student Learning on Complexity in Intelligent Routing, by Shu-ting Pi et al.
Teacher-Student Learning on Complexity in Intelligent Routingby Shu-Ting Pi, Michael Yang, Yuying Zhu, Qun LiuFirst…
Summary of Co-supervised Learning: Improving Weak-to-strong Generalization with Hierarchical Mixture Of Experts, by Yuejiang Liu et al.
Co-Supervised Learning: Improving Weak-to-Strong Generalization with Hierarchical Mixture of Expertsby Yuejiang Liu, Alexandre AlahiFirst submitted…
Summary of Wisdom Of Committee: Distilling From Foundation Model to Specialized Application Model, by Zichang Liu et al.
Wisdom of Committee: Distilling from Foundation Model to Specialized Application Modelby Zichang Liu, Qingyun Liu,…
Summary of Packd: Pattern-clustered Knowledge Distillation For Compressing Memory Access Prediction Models, by Neelesh Gupta et al.
PaCKD: Pattern-Clustered Knowledge Distillation for Compressing Memory Access Prediction Modelsby Neelesh Gupta, Pengmiao Zhang, Rajgopal…
Summary of Teacher As a Lenient Expert: Teacher-agnostic Data-free Knowledge Distillation, by Hyunjune Shin et al.
Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillationby Hyunjune Shin, Dong-Wan ChoiFirst submitted to…
Summary of Distilling Large Language Models For Text-attributed Graph Learning, by Bo Pan et al.
Distilling Large Language Models for Text-Attributed Graph Learningby Bo Pan, Zheng Zhang, Yifei Zhang, Yuntong…
Summary of Graphkd: Exploring Knowledge Distillation Towards Document Object Detection with Structured Graph Creation, by Ayan Banerjee et al.
GraphKD: Exploring Knowledge Distillation Towards Document Object Detection with Structured Graph Creationby Ayan Banerjee, Sanket…
Summary of Knowledge Distillation Based on Transformed Teacher Matching, by Kaixiang Zheng and En-hui Yang
Knowledge Distillation Based on Transformed Teacher Matchingby Kaixiang Zheng, En-Hui YangFirst submitted to arxiv on:…