SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuningby Chenyang Zhao, Xueying Jia, Vijay Viswanathan, Tongshuang…
Towards Optimal Trade-offs in Knowledge Distillation for CNNs and Vision Transformers at the Edgeby John…
Relational Representation Distillationby Nikolaos Giakoumoglou, Tania StathakiFirst submitted to arxiv on: 16 Jul 2024CategoriesMain: Computer…
Discriminative and Consistent Representation Distillationby Nikolaos Giakoumoglou, Tania StathakiFirst submitted to arxiv on: 16 Jul…
SeCoKD: Aligning Large Language Models for In-Context Learning with Fewer Shotsby Weixing Wang, Haojin Yang,…
BiLD: Bi-directional Logits Difference Loss for Large Language Model Distillationby Minchong Li, Feng Zhou, Xiaohui…
PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairsby Rongzhi Zhang, Jiaming Shen, Tianqi Liu,…
DP-IQA: Utilizing Diffusion Prior for Blind Image Quality Assessment in the Wildby Honghao Fu, Yufei…
D3T: Distinctive Dual-Domain Teacher Zigzagging Across RGB-Thermal Gap for Domain-Adaptive Object Detectionby Dinh Phat Do,…
ELAD: Explanation-Guided Large Language Models Active Distillationby Yifei Zhang, Bo Pan, Chen Ling, Yuntong Hu,…