Summary of Pushing the Envelope Of Low-bit Llm Via Dynamic Error Compensation, by Yeonhong Park et al.
Pushing the Envelope of Low-Bit LLM via Dynamic Error Compensationby Yeonhong Park, Jake Hyun, Hojoon…
Summary of Data-free Group-wise Fully Quantized Winograd Convolution Via Learnable Scales, by Shuokai Pan et al.
Data-Free Group-Wise Fully Quantized Winograd Convolution via Learnable Scalesby Shuokai Pan, Gerti Tuzi, Sudarshan Sreeram,…
Summary of Advanced Knowledge Transfer: Refined Feature Distillation For Zero-shot Quantization in Edge Computing, by Inpyo Hong et al.
Advanced Knowledge Transfer: Refined Feature Distillation for Zero-Shot Quantization in Edge Computingby Inpyo Hong, Youngwan…
Summary of Semantic Residual For Multimodal Unified Discrete Representation, by Hai Huang et al.
Semantic Residual for Multimodal Unified Discrete Representationby Hai Huang, Shulei Wang, Yan XiaFirst submitted to…
Summary of Recommending Pre-trained Models For Iot Devices, by Parth V. Patil et al.
Recommending Pre-Trained Models for IoT Devicesby Parth V. Patil, Wenxin Jiang, Huiyun Peng, Daniel Lugo,…
Summary of Unified Stochastic Framework For Neural Network Quantization and Pruning, by Haoyu Zhang et al.
Unified Stochastic Framework for Neural Network Quantization and Pruningby Haoyu Zhang, Rayan SaabFirst submitted to…
Summary of Gqsa: Group Quantization and Sparsity For Accelerating Large Language Model Inference, by Chao Zeng et al.
GQSA: Group Quantization and Sparsity for Accelerating Large Language Model Inferenceby Chao Zeng, Songwei Liu,…
Summary of Improving Quantization-aware Training Of Low-precision Network Via Block Replacement on Full-precision Counterpart, by Chengting Yu et al.
Improving Quantization-aware Training of Low-Precision Network via Block Replacement on Full-Precision Counterpartby Chengting Yu, Shu…
Summary of Preventing Local Pitfalls in Vector Quantization Via Optimal Transport, by Borui Zhang et al.
Preventing Local Pitfalls in Vector Quantization via Optimal Transportby Borui Zhang, Wenzhao Zheng, Jie Zhou,…
Summary of Mixllm: Llm Quantization with Global Mixed-precision Between Output-features and Highly-efficient System Design, by Zhen Zheng et al.
MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Designby Zhen Zheng, Xiaonan…