Layer-Wise Quantization: A Pragmatic and Effective Method for Quantizing LLMs Beyond Integer Bit-Levelsby Razvan-Gabriel Dumitru,…
CDQuant: Greedy Coordinate Descent for Accurate LLM Quantizationby Pranav Ajit Nair, Arun Sai SuggalaFirst submitted…
ShadowLLM: Predictor-based Contextual Sparsity for Large Language Modelsby Yash Akhauri, Ahmed F AbouElhamayed, Jordan Dotzel,…
HLQ: Fast and Efficient Backpropagation via Hadamard Low-rank Quantizationby Seonggon Kim, Eunhyeok ParkFirst submitted to…
Predicting Probabilities of Error to Combine Quantization and Early Exiting: QuEEby Florence Regol, Joud Chataoui,…
FLoCoRA: Federated learning compression with low-rank adaptationby Lucas Grativol Ribeiro, Mathieu Leonardon, Guillaume Muller, Virginie…
SDQ: Sparse Decomposed Quantization for LLM Inferenceby Geonhwa Jeong, Po-An Tsai, Stephen W. Keckler, Tushar…
BoA: Attention-aware Post-training Quantization without Backpropagationby Junhan Kim, Ho-young Kim, Eulrang Cho, Chungman Lee, Joonyoung…
Tender: Accelerating Large Language Models via Tensor Decomposition and Runtime Requantizationby Jungi Lee, Wonbeom Lee,…
Human-level molecular optimization driven by mol-gene evolutionby Jiebin Fang, Churu Mao, Yuchen Zhu, Xiaoming Chen,…