Summary of Divide-or-conquer? Which Part Should You Distill Your Llm?, by Zhuofeng Wu et al.
Divide-or-Conquer? Which Part Should You Distill Your LLM?by Zhuofeng Wu, He Bai, Aonan Zhang, Jiatao…
Summary of Enhancing One-shot Federated Learning Through Data and Ensemble Co-boosting, by Rong Dai et al.
Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boostingby Rong Dai, Yonggang Zhang, Ang Li,…
Summary of Distillation Contrastive Decoding: Improving Llms Reasoning with Contrastive Decoding and Distillation, by Phuc Phan et al.
Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillationby Phuc Phan, Hieu Tran,…
Summary of Wisdom Of Committee: Distilling From Foundation Model to Specialized Application Model, by Zichang Liu et al.
Wisdom of Committee: Distilling from Foundation Model to Specialized Application Modelby Zichang Liu, Qingyun Liu,…
Summary of Sdxl-lightning: Progressive Adversarial Diffusion Distillation, by Shanchuan Lin et al.
SDXL-Lightning: Progressive Adversarial Diffusion Distillationby Shanchuan Lin, Anran Wang, Xiao YangFirst submitted to arxiv on:…
Summary of Improve Cross-architecture Generalization on Dataset Distillation, by Binglin Zhou et al.
Improve Cross-Architecture Generalization on Dataset Distillationby Binglin Zhou, Linhao Zhong, Wentao ChenFirst submitted to arxiv…
Summary of Teacher As a Lenient Expert: Teacher-agnostic Data-free Knowledge Distillation, by Hyunjune Shin et al.
Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillationby Hyunjune Shin, Dong-Wan ChoiFirst submitted to…
Summary of Db-llm: Accurate Dual-binarization For Efficient Llms, by Hong Chen et al.
DB-LLM: Accurate Dual-Binarization for Efficient LLMsby Hong Chen, Chengtao Lv, Liang Ding, Haotong Qin, Xiabin…
Summary of Graphkd: Exploring Knowledge Distillation Towards Document Object Detection with Structured Graph Creation, by Ayan Banerjee et al.
GraphKD: Exploring Knowledge Distillation Towards Document Object Detection with Structured Graph Creationby Ayan Banerjee, Sanket…
Summary of Multi-modal Preference Alignment Remedies Degradation Of Visual Instruction Tuning on Language Models, by Shengzhi Li et al.
Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language Modelsby Shengzhi Li, Rongyu…