Summary of Weakly Supervised Deep Hyperspherical Quantization For Image Retrieval, by Jinpeng Wang et al.
Weakly Supervised Deep Hyperspherical Quantization for Image Retrievalby Jinpeng Wang, Bin Chen, Qiang Zhang, Zaiqiao…
Summary of Accurate Block Quantization in Llms with Outliers, by Nikita Trukhanov and Ilya Soloveychik
Accurate Block Quantization in LLMs with Outliersby Nikita Trukhanov, Ilya SoloveychikFirst submitted to arxiv on:…
Summary of Qncd: Quantization Noise Correction For Diffusion Models, by Huanpeng Chu et al.
QNCD: Quantization Noise Correction for Diffusion Modelsby Huanpeng Chu, Wei Wu, Chengjie Zang, Kun YuanFirst…
Summary of Decoding Compressed Trust: Scrutinizing the Trustworthiness Of Efficient Llms Under Compression, by Junyuan Hong et al.
Decoding Compressed Trust: Scrutinizing the Trustworthiness of Efficient LLMs Under Compressionby Junyuan Hong, Jinhao Duan,…
Summary of Unicode: Learning a Unified Codebook For Multimodal Large Language Models, by Sipeng Zheng et al.
UniCode: Learning a Unified Codebook for Multimodal Large Language Modelsby Sipeng Zheng, Bohan Zhou, Yicheng…
Summary of Intactkv: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact, By Ruikang Liu et al.
IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intactby Ruikang Liu, Haoli Bai,…
Summary of Evaluating Quantized Large Language Models, by Shiyao Li et al.
Evaluating Quantized Large Language Modelsby Shiyao Li, Xuefei Ning, Luning Wang, Tengxuan Liu, Xiangsheng Shi,…
Summary of A Comprehensive Evaluation Of Quantization Strategies For Large Language Models, by Renren Jin et al.
A Comprehensive Evaluation of Quantization Strategies for Large Language Modelsby Renren Jin, Jiangcun Du, Wuwei…
Summary of Llm Inference Unveiled: Survey and Roofline Model Insights, by Zhihang Yuan et al.
LLM Inference Unveiled: Survey and Roofline Model Insightsby Zhihang Yuan, Yuzhang Shang, Yang Zhou, Zhen…
Summary of Towards Accurate Post-training Quantization For Reparameterized Models, by Luoming Zhang et al.
Towards Accurate Post-training Quantization for Reparameterized Modelsby Luoming Zhang, Yefei He, Wen Fei, Zhenyu Lou,…