Summary of Resq: Mixed-precision Quantization Of Large Language Models with Low-rank Residuals, by Utkarsh Saxena et al.
ResQ: Mixed-Precision Quantization of Large Language Models with Low-Rank Residualsby Utkarsh Saxena, Sayeh Sharify, Kaushik…
Summary of Vidtok: a Versatile and Open-source Video Tokenizer, by Anni Tang et al.
VidTok: A Versatile and Open-Source Video Tokenizerby Anni Tang, Tianyu He, Junliang Guo, Xinle Cheng,…
Summary of Apollo-forecast: Overcoming Aliasing and Inference Speed Challenges in Language Models For Time Series Forecasting, by Tianyi Yin et al.
Apollo-Forecast: Overcoming Aliasing and Inference Speed Challenges in Language Models for Time Series Forecastingby Tianyi…
Summary of Fast and Slow Gradient Approximation For Binary Neural Network Optimization, by Xinquan Chen et al.
Fast and Slow Gradient Approximation for Binary Neural Network Optimizationby Xinquan Chen, Junqi Gao, Biqing…
Summary of Qpruner: Probabilistic Decision Quantization For Structured Pruning in Large Language Models, by Changhai Zhou and Yuhua Zhou and Shijie Han and Qian Qiao and Hongguang Li
QPruner: Probabilistic Decision Quantization for Structured Pruning in Large Language Modelsby Changhai Zhou, Yuhua Zhou,…
Summary of Finlora: Finetuning Quantized Financial Large Language Models Using Low-rank Adaptation, by Dannong Wang et al.
FinLoRA: Finetuning Quantized Financial Large Language Models Using Low-Rank Adaptationby Dannong Wang, Daniel Kim, Bo…
Summary of Progressive Compression with Universally Quantized Diffusion Models, by Yibo Yang et al.
Progressive Compression with Universally Quantized Diffusion Modelsby Yibo Yang, Justus C. Will, Stephan MandtFirst submitted…
Summary of Adaptive Quantization Resolution and Power Control For Federated Learning Over Cell-free Networks, by Afsaneh Mahmoudi et al.
Adaptive Quantization Resolution and Power Control for Federated Learning over Cell-free Networksby Afsaneh Mahmoudi, Emil…
Summary of Memory-efficient 4-bit Preconditioned Stochastic Optimization, by Jingyang Li et al.
Memory-Efficient 4-bit Preconditioned Stochastic Optimizationby Jingyang Li, Kuangyu Ding, Kim-Chuan Toh, Pan ZhouFirst submitted to…
Summary of Efficient Generative Modeling with Residual Vector Quantization-based Tokens, by Jaehyeon Kim et al.
Efficient Generative Modeling with Residual Vector Quantization-Based Tokensby Jaehyeon Kim, Taehong Moon, Keon Lee, Jaewoong…