Summary of Q-s5: Towards Quantized State Space Models, by Steven Abreu et al.
Q-S5: Towards Quantized State Space Modelsby Steven Abreu, Jens E. Pedersen, Kade M. Heckel, Alessandro…
Summary of Me-switch: a Memory-efficient Expert Switching Framework For Large Language Models, by Jing Liu et al.
ME-Switch: A Memory-Efficient Expert Switching Framework for Large Language Modelsby Jing Liu, Ruihao Gong, Mingyang…
Summary of Asymptotic Unbiased Sample Sampling to Speed Up Sharpness-aware Minimization, by Jiaxin Deng et al.
Asymptotic Unbiased Sample Sampling to Speed Up Sharpness-Aware Minimizationby Jiaxin Deng, Junbiao Pang, Baochang ZhangFirst…
Summary of Quantmoe-bench: Examining Post-training Quantization For Mixture-of-experts, by Pingzhi Li et al.
QuantMoE-Bench: Examining Post-Training Quantization for Mixture-of-Expertsby Pingzhi Li, Xiaolong Jin, Zhen Tan, Yu Cheng, Tianlong…
Summary of Image and Video Tokenization with Binary Spherical Quantization, by Yue Zhao et al.
Image and Video Tokenization with Binary Spherical Quantizationby Yue Zhao, Yuanjun Xiong, Philipp KrähenbühlFirst submitted…
Summary of Ternaryllm: Ternarized Large Language Model, by Tianqi Chen et al.
TernaryLLM: Ternarized Large Language Modelby Tianqi Chen, Zhe Li, Weixiang Xu, Zeyu Zhu, Dong Li,…
Summary of Low-rank Quantization-aware Training For Llms, by Yelysei Bondarenko et al.
Low-Rank Quantization-Aware Training for LLMsby Yelysei Bondarenko, Riccardo Del Chiaro, Markus NagelFirst submitted to arxiv…
Summary of Efficient Neural Compression with Inference-time Decoding, by C. Metz et al.
Efficient Neural Compression with Inference-time Decodingby C. Metz, O. Bichler, A. DupretFirst submitted to arxiv…
Summary of Winner-takes-all Learners Are Geometry-aware Conditional Density Estimators, by Victor Letzelter (ltci et al.
Winner-takes-all learners are geometry-aware conditional density estimatorsby Victor Letzelter, David Perera, Cédric Rommel, Mathieu Fontaine,…
Summary of Qjl: 1-bit Quantized Jl Transform For Kv Cache Quantization with Zero Overhead, by Amir Zandieh et al.
QJL: 1-Bit Quantized JL Transform for KV Cache Quantization with Zero Overheadby Amir Zandieh, Majid…