Summary of Small Scale Data-free Knowledge Distillation, by He Liu et al.
Small Scale Data-Free Knowledge Distillationby He Liu, Yikai Wang, Huaping Liu, Fuchun Sun, Anbang YaoFirst…
Summary of Ternaryllm: Ternarized Large Language Model, by Tianqi Chen et al.
TernaryLLM: Ternarized Large Language Modelby Tianqi Chen, Zhe Li, Weixiang Xu, Zeyu Zhu, Dong Li,…
Summary of Dkdl-net: a Lightweight Bearing Fault Detection Model Via Decoupled Knowledge Distillation and Low-rank Adaptation Fine-tuning, by Ovanes Petrosian and Li Pengyi and He Yulong and Liu Jiarui and Sun Zhaoruikun and Fu Guofeng and Meng Liping
DKDL-Net: A Lightweight Bearing Fault Detection Model via Decoupled Knowledge Distillation and Low-Rank Adaptation Fine-tuningby…
Summary of Mutual Information Guided Backdoor Mitigation For Pre-trained Encoders, by Tingxu Han et al.
Mutual Information Guided Backdoor Mitigation for Pre-trained Encodersby Tingxu Han, Weisong Sun, Ziqi Ding, Chunrong…
Summary of Robust Knowledge Distillation Based on Feature Variance Against Backdoored Teacher Model, by Jinyin Chen et al.
Robust Knowledge Distillation Based on Feature Variance Against Backdoored Teacher Modelby Jinyin Chen, Xiaoming Zhao,…
Summary of Tiny Models From Tiny Data: Textual and Null-text Inversion For Few-shot Distillation, by Erik Landolsi et al.
Tiny models from tiny data: Textual and null-text inversion for few-shot distillationby Erik Landolsi, Fredrik…
Summary of Adversarial Moment-matching Distillation Of Large Language Models, by Chen Jia
Adversarial Moment-Matching Distillation of Large Language Modelsby Chen JiaFirst submitted to arxiv on: 5 Jun…
Summary of Pefad: a Parameter-efficient Federated Framework For Time Series Anomaly Detection, by Ronghui Xu et al.
PeFAD: A Parameter-Efficient Federated Framework for Time Series Anomaly Detectionby Ronghui Xu, Hao Miao, Senzhang…
Summary of Vision-language Meets the Skeleton: Progressively Distillation with Cross-modal Knowledge For 3d Action Representation Learning, by Yang Chen et al.
Vision-Language Meets the Skeleton: Progressively Distillation with Cross-Modal Knowledge for 3D Action Representation Learningby Yang…
Summary of Adv-kd: Adversarial Knowledge Distillation For Faster Diffusion Sampling, by Kidist Amde Mekonnen et al.
Adv-KD: Adversarial Knowledge Distillation for Faster Diffusion Samplingby Kidist Amde Mekonnen, Nicola Dall'Asen, Paolo RotaFirst…