Partial Knowledge Distillation for Alleviating the Inherent Inter-Class Discrepancy in Federated Learningby Xiaoyu Gan, Xizi…
BanglaEmbed: Efficient Sentence Embedding Models for a Low-Resource Language Using Cross-Lingual Distillation Techniquesby Muhammad Rafsan…
Adaptive Group Robust Ensemble Knowledge Distillationby Patrik Kenfack, Ulrich Aïvodji, Samira Ebrahimi KahouFirst submitted to…
Simplifying CLIP: Unleashing the Power of Large-Scale Models on Consumer-level Computersby Hongbo LiuFirst submitted to…
Just KIDDIN: Knowledge Infusion and Distillation for Detection of INdecent Memesby Rahul Garg, Trilok Padhi,…
Hybrid Attention Model Using Feature Decomposition and Knowledge Distillation for Glucose Forecastingby Ebrahim Farahmand, Shovito…
Evidential Federated Learning for Skin Lesion Image Classificationby Rutger Hendrix, Federica Proietto Salanitri, Concetto Spampinato,…
Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Headby Penghui Yang, Chen-Chen Zong, Sheng-Jun…
ScaleKD: Strong Vision Transformers Could Be Excellent Teachersby Jiawei Fan, Chao Li, Xiaolong Liu, Anbang…
LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Modelsby Runming Yang, Taiqiang Wu, Jiahao Wang,…