Summary of Exaq: Exponent Aware Quantization For Llms Acceleration, by Moran Shkolnik et al.
EXAQ: Exponent Aware Quantization For LLMs Accelerationby Moran Shkolnik, Maxim Fishman, Brian Chmiel, Hilla Ben-Yaacov,…
Summary of Overcoming Representation Bias in Fairness-aware Data Repair Using Optimal Transport, by Abigail Langbridge and Anthony Quinn and Robert Shorten
Overcoming Representation Bias in Fairness-Aware data Repair using Optimal Transportby Abigail Langbridge, Anthony Quinn, Robert…
Summary of Sageattention: Accurate 8-bit Attention For Plug-and-play Inference Acceleration, by Jintao Zhang et al.
SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationby Jintao Zhang, Jia wei, Haofeng Huang, Pengle…
Summary of Seal: Semantic-augmented Imitation Learning Via Language Model, by Chengyang Gu et al.
SEAL: SEmantic-Augmented Imitation Learning via Language Modelby Chengyang Gu, Yuxin Pan, Haotian Bai, Hui Xiong,…
Summary of Quantized and Asynchronous Federated Learning, by Tomas Ortega and Hamid Jafarkhani
Quantized and Asynchronous Federated Learningby Tomas Ortega, Hamid JafarkhaniFirst submitted to arxiv on: 30 Sep…
Summary of Rotated Runtime Smooth: Training-free Activation Smoother For Accurate Int4 Inference, by Ke Yi et al.
Rotated Runtime Smooth: Training-Free Activation Smoother for accurate INT4 inferenceby Ke Yi, Zengke Liu, Jianwei…
Summary of Constraint Guided Model Quantization Of Neural Networks, by Quinten Van Baelen and Peter Karsmakers
Constraint Guided Model Quantization of Neural Networksby Quinten Van Baelen, Peter KarsmakersFirst submitted to arxiv…
Summary of Efficient Arbitrary Precision Acceleration For Large Language Models on Gpu Tensor Cores, by Shaobo Ma et al.
Efficient Arbitrary Precision Acceleration for Large Language Models on GPU Tensor Coresby Shaobo Ma, Chao…
Summary of Language Models As Zero-shot Lossless Gradient Compressors: Towards General Neural Parameter Prior Models, by Hui-po Wang et al.
Language Models as Zero-shot Lossless Gradient Compressors: Towards General Neural Parameter Prior Modelsby Hui-Po Wang,…
Summary of Int-flashattention: Enabling Flash Attention For Int8 Quantization, by Shimao Chen et al.
INT-FlashAttention: Enabling Flash Attention for INT8 Quantizationby Shimao Chen, Zirui Liu, Zhiying Wu, Ce Zheng,…