Harnessing Your DRAM and SSD for Sustainable and Accessible LLM Inference with Mixed-Precision and Multi-level…
QuAILoRA: Quantization-Aware Initialization for LoRAby Neal Lawton, Aishwarya Padmakumar, Judith Gaspers, Jack FitzGerald, Anoop Kumar,…
The Representation of Meaningful Precision, and Accuracyby A ManiFirst submitted to arxiv on: 14 Oct…
Understanding the difficulty of low-precision post-training quantization of large language modelsby Zifei Xu, Sayeh Sharify,…
A Scientific Machine Learning Approach for Predicting and Forecasting Battery Degradation in Electric Vehiclesby Sharv…
How Numerical Precision Affects Mathematical Reasoning Capabilities of LLMsby Guhao Feng, Kai Yang, Yuntian Gu,…
Progressive Mixed-Precision Decoding for Efficient LLM Inferenceby Hao Mark Chen, Fuwen Tan, Alexandros Kouris, Royson…
Metal Price Spike Prediction via a Neurosymbolic Ensemble Approachby Nathaniel Lee, Noel Ngu, Harshdeep Singh…
Stress Assessment with Convolutional Neural Network Using PPG Signalsby Yasin Hasanpoor, Bahram Tarvirdizadeh, Khalil Alipour,…
Scaling Laws for Post Training Quantized Large Language Modelsby Zifei Xu, Alexander Lan, Wanzin Yazar,…