Towards Personalized Federated Learning via Comprehensive Knowledge Distillationby Pengju Wang, Bochao Liu, Weijia Guo, Yong…
Against Multifaceted Graph Heterogeneity via Asymmetric Federated Prompt Learningby Zhuoning Guo, Ruiqian Han, Hao LiuFirst…
Decoupling Dark Knowledge via Block-wise Logit Distillation for Feature-level Alignmentby Chengting Yu, Fengzhao Zhang, Ruizhe…
Semantic Knowledge Distillation for Onboard Satellite Earth Observation Image Classificationby Thanh-Dung Le, Vu Nguyen Ha,…
KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillationby Rambod Azimi, Rishav…
Deep Learning for Medical Text Processing: BERT Model Fine-Tuning and Comparative Studyby Jiacheng Hu, Yiru…
Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRAby Sangmin Bae, Adam Fisch, Hrayr Harutyunyan,…
Large Model for Small Data: Foundation Model for Cross-Modal RF Human Activity Recognitionby Yuxuan Weng,…
High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Lawsby M. Emrullah Ildiz, Halil Alperen…
Knowledge Distillation Using Frontier Open-source LLMs: Generalizability and the Role of Synthetic Databy Anup Shirgaonkar,…