Genetic Quantization-Aware Approximation for Non-Linear Operations in Transformersby Pingcheng Dong, Yonghao Tan, Dong Zhang, Tianwei…
Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Modelsby…
The Unreasonable Ineffectiveness of the Deeper Layersby Andrey Gromov, Kushal Tirumala, Hassan Shapourian, Paolo Glorioso,…
Neural Image Compression with Quantization Rectifierby Wei Luo, Bo ChenFirst submitted to arxiv on: 25…
SignSGD with Federated Votingby Chanho Park, H. Vincent Poor, Namyoon LeeFirst submitted to arxiv on:…
Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidanceby Hao Wu, Fan Xu, Yifan…
MELTing point: Mobile Evaluation of Language Transformersby Stefanos Laskaridis, Kleomenis Katevas, Lorenzo Minto, Hamed HaddadiFirst…
AffineQuant: Affine Transformation Quantization for Large Language Modelsby Yuexiao Ma, Huixia Li, Xiawu Zheng, Feng…
Jetfire: Efficient and Accurate Transformer Pretraining with INT8 Data Flow and Per-Block Quantizationby Haocheng Xi,…
Self-Supervised Quantization-Aware Knowledge Distillationby Kaiqi Zhao, Ming ZhaoFirst submitted to arxiv on: 17 Mar 2024CategoriesMain:…