Summary of An Exploration Of the Effect Of Quantisation on Energy Consumption and Inference Time Of Starcoder2, by Pepijn De Reus et al.
An exploration of the effect of quantisation on energy consumption and inference time of StarCoder2by…
Summary of Amxfp4: Taming Activation Outliers with Asymmetric Microscaling Floating-point For 4-bit Llm Inference, by Janghwan Lee et al.
AMXFP4: Taming Activation Outliers with Asymmetric Microscaling Floating-Point for 4-bit LLM Inferenceby Janghwan Lee, Jiwoong…
Summary of The Super Weight in Large Language Models, by Mengxia Yu et al.
The Super Weight in Large Language Modelsby Mengxia Yu, De Wang, Qi Shan, Colorado Reed,…
Summary of Qwen2.5-32b: Leveraging Self-consistent Tool-integrated Reasoning For Bengali Mathematical Olympiad Problem Solving, by Saad Tahmid and Sourav Sarker
Qwen2.5-32B: Leveraging Self-Consistent Tool-Integrated Reasoning for Bengali Mathematical Olympiad Problem Solvingby Saad Tahmid, Sourav SarkerFirst…
Summary of Aligned Vector Quantization For Edge-cloud Collabrative Vision-language Models, by Xiao Liu et al.
Aligned Vector Quantization for Edge-Cloud Collabrative Vision-Language Modelsby Xiao Liu, Lijun Zhang, Deepak Ganesan, Hui…
Summary of Eora: Training-free Compensation For Compressed Llm with Eigenspace Low-rank Approximation, by Shih-yang Liu et al.
EoRA: Training-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximationby Shih-Yang Liu, Maksim Khadkevich, Nai…
Summary of A Counterexample in Cross-correlation Template Matching, by Serap A. Savari
A Counterexample in Cross-Correlation Template Matchingby Serap A. SavariFirst submitted to arxiv on: 24 Oct…
Summary of Catastrophic Failure Of Llm Unlearning Via Quantization, by Zhiwei Zhang et al.
Catastrophic Failure of LLM Unlearning via Quantizationby Zhiwei Zhang, Fali Wang, Xiaomin Li, Zongyu Wu,…
Summary of Lossless Kv Cache Compression to 2%, by Zhen Yang et al.
Lossless KV Cache Compression to 2%by Zhen Yang, J.N.Han, Kan Wu, Ruobing Xie, An Wang,…
Summary of Channel-wise Mixed-precision Quantization For Large Language Models, by Zihan Chen et al.
Channel-Wise Mixed-Precision Quantization for Large Language Modelsby Zihan Chen, Bike Xie, Jundong Li, Cong ShenFirst…