Summary of Accumulator-aware Post-training Quantization, by Ian Colbert et al.
Accumulator-Aware Post-Training Quantizationby Ian Colbert, Fabian Grob, Giuseppe Franco, Jinjie Zhang, Rayan SaabFirst submitted to…
Summary of Alignedkv: Reducing Memory Access Of Kv-cache with Precision-aligned Quantization, by Yifan Tan and Haoze Wang and Chao Yan and Yangdong Deng
AlignedKV: Reducing Memory Access of KV-Cache with Precision-Aligned Quantizationby Yifan Tan, Haoze Wang, Chao Yan,…
Summary of A Survey Of Low-bit Large Language Models: Basics, Systems, and Algorithms, by Ruihao Gong et al.
A Survey of Low-bit Large Language Models: Basics, Systems, and Algorithmsby Ruihao Gong, Yifu Ding,…
Summary of Communication and Energy Efficient Federated Learning Using Zero-order Optimization Technique, by Elissa Mhanna and Mohamad Assaad
Communication and Energy Efficient Federated Learning using Zero-Order Optimization Techniqueby Elissa Mhanna, Mohamad AssaadFirst submitted…
Summary of Disentanglement with Factor Quantized Variational Autoencoders, by Gulcin Baykal et al.
Disentanglement with Factor Quantized Variational Autoencodersby Gulcin Baykal, Melih Kandemir, Gozde UnalFirst submitted to arxiv…
Summary of Corbin-fl: a Differentially Private Federated Learning Mechanism Using Common Randomness, by Hojat Allah Salehi et al.
CorBin-FL: A Differentially Private Federated Learning Mechanism using Common Randomnessby Hojat Allah Salehi, Md Jueal…
Summary of Bilateral Sharpness-aware Minimization For Flatter Minima, by Jiaxin Deng et al.
Bilateral Sharpness-Aware Minimization for Flatter Minimaby Jiaxin Deng, Junbiao Pang, Baochang Zhang, Qingming HuangFirst submitted…
Summary of Scaling Fp8 Training to Trillion-token Llms, by Maxim Fishman et al.
Scaling FP8 training to trillion-token LLMsby Maxim Fishman, Brian Chmiel, Ron Banner, Daniel SoudryFirst submitted…
Summary of Pareto Data Framework: Steps Towards Resource-efficient Decision Making Using Minimum Viable Data (mvd), by Tashfain Ahmed and Josh Siegel
Pareto Data Framework: Steps Towards Resource-Efficient Decision Making Using Minimum Viable Data (MVD)by Tashfain Ahmed,…
Summary of Art and Science Of Quantizing Large-scale Models: a Comprehensive Overview, by Yanshu Wang et al.
Art and Science of Quantizing Large-Scale Models: A Comprehensive Overviewby Yanshu Wang, Tong Yang, Xiyan…