Summary of Mamba-ptq: Outlier Channels in Recurrent Large Language Models, by Alessandro Pierro et al.
Mamba-PTQ: Outlier Channels in Recurrent Large Language Modelsby Alessandro Pierro, Steven AbreuFirst submitted to arxiv…
Summary of Spectra: Surprising Effectiveness Of Pretraining Ternary Language Models at Scale, by Ayush Kaushal et al.
Spectra: Surprising Effectiveness of Pretraining Ternary Language Models at Scaleby Ayush Kaushal, Tejas Vaidhya, Arnab…
Summary of Co-designing Binarized Transformer and Hardware Accelerator For Efficient End-to-end Edge Deployment, by Yuhao Ji et al.
Co-Designing Binarized Transformer and Hardware Accelerator for Efficient End-to-End Edge Deploymentby Yuhao Ji, Chao Fang,…
Summary of Tiled Bit Networks: Sub-bit Neural Network Compression Through Reuse Of Learnable Binary Vectors, by Matt Gorbett et al.
Tiled Bit Networks: Sub-Bit Neural Network Compression Through Reuse of Learnable Binary Vectorsby Matt Gorbett,…
Summary of Exploring Quantization For Efficient Pre-training Of Transformer Language Models, by Kamran Chitsaz et al.
Exploring Quantization for Efficient Pre-Training of Transformer Language Modelsby Kamran Chitsaz, Quentin Fournier, Gonçalo Mordido,…
Summary of Lrq: Optimizing Post-training Quantization For Large Language Models by Learning Low-rank Weight-scaling Matrices, By Jung Hyun Lee et al.
LRQ: Optimizing Post-Training Quantization for Large Language Models by Learning Low-Rank Weight-Scaling Matricesby Jung Hyun…
Summary of Efficientqat: Efficient Quantization-aware Training For Large Language Models, by Mengzhao Chen et al.
EfficientQAT: Efficient Quantization-Aware Training for Large Language Modelsby Mengzhao Chen, Wenqi Shao, Peng Xu, Jiahao…
Summary of Isquant: Apply Squant to the Real Deployment, by Dezan Zhao
ISQuant: apply squant to the real deploymentby Dezan ZhaoFirst submitted to arxiv on: 5 Jul…
Summary of Integer-only Quantized Transformers For Embedded Fpga-based Time-series Forecasting in Aiot, by Tianheng Ling et al.
Integer-only Quantized Transformers for Embedded FPGA-based Time-series Forecasting in AIoTby Tianheng Ling, Chao Qian, Gregor…
Summary of Fast Matrix Multiplications For Lookup Table-quantized Llms, by Han Guo et al.
Fast Matrix Multiplications for Lookup Table-Quantized LLMsby Han Guo, William Brandon, Radostin Cholakov, Jonathan Ragan-Kelley,…