Summary of Distilling Invariant Representations with Dual Augmentation, by Nikolaos Giakoumoglou et al.
Distilling Invariant Representations with Dual Augmentationby Nikolaos Giakoumoglou, Tania StathakiFirst submitted to arxiv on: 12…
Summary of Gai-enabled Explainable Personalized Federated Semi-supervised Learning, by Yubo Peng et al.
GAI-Enabled Explainable Personalized Federated Semi-Supervised Learningby Yubo Peng, Feibo Jiang, Li Dong, Kezhi Wang, Kun…
Summary of What Is Left After Distillation? How Knowledge Transfer Impacts Fairness and Bias, by Aida Mohammadshahi et al.
What is Left After Distillation? How Knowledge Transfer Impacts Fairness and Biasby Aida Mohammadshahi, Yani…
Summary of Efficient and Robust Knowledge Distillation From a Stronger Teacher Based on Correlation Matching, by Wenqi Niu et al.
Efficient and Robust Knowledge Distillation from A Stronger Teacher Based on Correlation Matchingby Wenqi Niu,…
Summary of Progressive Distillation Induces An Implicit Curriculum, by Abhishek Panigrahi et al.
Progressive distillation induces an implicit curriculumby Abhishek Panigrahi, Bingbin Liu, Sadhika Malladi, Andrej Risteski, Surbhi…
Summary of Dataset Distillation Via Knowledge Distillation: Towards Efficient Self-supervised Pre-training Of Deep Networks, by Siddharth Joshi et al.
Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep Networksby Siddharth Joshi, Jiayi…
Summary of Phi-s: Distribution Balancing For Label-free Multi-teacher Distillation, by Mike Ranzinger et al.
PHI-S: Distribution Balancing for Label-Free Multi-Teacher Distillationby Mike Ranzinger, Jon Barker, Greg Heinrich, Pavlo Molchanov,…
Summary of Foldable Supernets: Scalable Merging Of Transformers with Different Initializations and Tasks, by Edan Kinderman et al.
Foldable SuperNets: Scalable Merging of Transformers with Different Initializations and Tasksby Edan Kinderman, Itay Hubara,…
Summary of Collaborative Knowledge Distillation Via a Learning-by-education Node Community, by Anestis Kaimakamidis et al.
Collaborative Knowledge Distillation via a Learning-by-Education Node Communityby Anestis Kaimakamidis, Ioannis Mademlis, Ioannis PitasFirst submitted…
Summary of Linear Projections Of Teacher Embeddings For Few-class Distillation, by Noel Loo et al.
Linear Projections of Teacher Embeddings for Few-Class Distillationby Noel Loo, Fotis Iliopoulos, Wei Hu, Erik…