Summary of Efficient Llm Context Distillation, by Rajesh Upadhayayaya et al.
Efficient LLM Context Distillationby Rajesh Upadhayayaya, Zachary Smith, Chritopher Kottmyer, Manish Raj OstiFirst submitted to…
Summary of Dataset Distillation From First Principles: Integrating Core Information Extraction and Purposeful Learning, by Vyacheslav Kungurtsev et al.
Dataset Distillation from First Principles: Integrating Core Information Extraction and Purposeful Learningby Vyacheslav Kungurtsev, Yuanfang…
Summary of Error-controlled Non-additive Interaction Discovery in Machine Learning Models, by Winston Chen et al.
Error-controlled non-additive interaction discovery in machine learning modelsby Winston Chen, Yifan Jiang, William Stafford Noble,…
Summary of Instant Adversarial Purification with Adversarial Consistency Distillation, by Chun Tong Lei et al.
Instant Adversarial Purification with Adversarial Consistency Distillationby Chun Tong Lei, Hon Ming Yam, Zhongliang Guo,…
Summary of Gstam: Efficient Graph Distillation with Structural Attention-matching, by Arash Rasti-meymandi et al.
GSTAM: Efficient Graph Distillation with Structural Attention-Matchingby Arash Rasti-Meymandi, Ahmad Sajedi, Zhaopan Xu, Konstantinos N.…
Summary of Learning Harmonized Representations For Speculative Sampling, by Lefan Zhang et al.
Learning Harmonized Representations for Speculative Samplingby Lefan Zhang, Xiaodan Wang, Yanhua Huang, Ruiwen XuFirst submitted…
Summary of Boosting Lossless Speculative Decoding Via Feature Sampling and Partial Alignment Distillation, by Lujun Gui et al.
Boosting Lossless Speculative Decoding via Feature Sampling and Partial Alignment Distillationby Lujun Gui, Bin Xiao,…
Summary of The Mamba in the Llama: Distilling and Accelerating Hybrid Models, by Junxiong Wang et al.
The Mamba in the Llama: Distilling and Accelerating Hybrid Modelsby Junxiong Wang, Daniele Paliotta, Avner…
Summary of Learning Differentially Private Diffusion Models Via Stochastic Adversarial Distillation, by Bochao Liu et al.
Learning Differentially Private Diffusion Models via Stochastic Adversarial Distillationby Bochao Liu, Pengju Wang, Shiming GeFirst…
Summary of Distilling Long-tailed Datasets, by Zhenghao Zhao et al.
Distilling Long-tailed Datasetsby Zhenghao Zhao, Haoxuan Wang, Yuzhang Shang, Kai Wang, Yan YanFirst submitted to…