Integrating ChatGPT into Secure Hospital Networks: A Case Study on Improving Radiology Report Analysisby Kyungsu…
FedSiKD: Clients Similarity and Knowledge Distillation: Addressing Non-i.i.d. and Constraints in Federated Learningby Yousef Alsenani,…
Training Heterogeneous Client Models using Knowledge Distillation in Serverless Federated Learningby Mohak Chadha, Pulkit Khera,…
Embedding Compression for Teacher-to-Student Knowledge Transferby Yiwei Ding, Alexander LerchFirst submitted to arxiv on: 9…
A Survey on Transformer Compressionby Yehui Tang, Yunhe Wang, Jianyuan Guo, Zhijun Tu, Kai Han,…
Cooperative Knowledge Distillation: A Learner Agnostic Approachby Michael Livanos, Ian Davidson, Stephen WongFirst submitted to…
Beyond Answers: Transferring Reasoning Capabilities to Smaller LLMs Using Multi-Teacher Knowledge Distillationby Yijun Tian, Yikun…
DistiLLM: Towards Streamlined Distillation for Large Language Modelsby Jongwoo Ko, Sungnyun Kim, Tianyi Chen, Se-Young…
BGE M3-Embedding: Multi-Lingual, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationby Jianlv Chen, Shitao Xiao, Peitian…
Good Teachers Explain: Explanation-Enhanced Knowledge Distillationby Amin Parchami-Araghi, Moritz Böhle, Sukrut Rao, Bernt SchieleFirst submitted…