Summary of Evaluating the Generalization Ability Of Quantized Llms: Benchmark, Analysis, and Toolbox, by Yijun Liu et al.
Evaluating the Generalization Ability of Quantized LLMs: Benchmark, Analysis, and Toolboxby Yijun Liu, Yuan Meng,…
Summary of Mixture Of Scales: Memory-efficient Token-adaptive Binarization For Large Language Models, by Dongwon Jo et al.
Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Modelsby Dongwon Jo, Taesu Kim, Yulhwa…
Summary of Prefixing Attention Sinks Can Mitigate Activation Outliers For Large Language Model Quantization, by Seungwoo Son et al.
Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantizationby Seungwoo Son, Wonpyo…
Summary of Excp: Extreme Llm Checkpoint Compression Via Weight-momentum Joint Shrinking, by Wenshuo Li et al.
ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinkingby Wenshuo Li, Xinghao Chen, Han Shu,…
Summary of Qtip: Quantization with Trellises and Incoherence Processing, by Albert Tseng et al.
QTIP: Quantization with Trellises and Incoherence Processingby Albert Tseng, Qingyao Sun, David Hou, Christopher De…
Summary of Promoting Data and Model Privacy in Federated Learning Through Quantized Lora, by Jianhao Zhu et al.
Promoting Data and Model Privacy in Federated Learning through Quantized LoRAby JianHao Zhu, Changze Lv,…
Summary of Memory Faults in Activation-sparse Quantized Deep Neural Networks: Analysis and Mitigation Using Sharpness-aware Training, by Akul Malhotra et al.
Memory Faults in Activation-sparse Quantized Deep Neural Networks: Analysis and Mitigation using Sharpness-aware Trainingby Akul…
Summary of Mobileaibench: Benchmarking Llms and Lmms For On-device Use Cases, by Rithesh Murthy et al.
MobileAIBench: Benchmarking LLMs and LMMs for On-Device Use Casesby Rithesh Murthy, Liangwei Yang, Juntao Tan,…
Summary of Precipitation Nowcasting Using Physics Informed Discriminator Generative Models, by Junzhe Yin et al.
Precipitation Nowcasting Using Physics Informed Discriminator Generative Modelsby Junzhe Yin, Cristian Meo, Ankush Roy, Zeineh…
Summary of Qqq: Quality Quattuor-bit Quantization For Large Language Models, by Ying Zhang et al.
QQQ: Quality Quattuor-Bit Quantization for Large Language Modelsby Ying Zhang, Peng Zhang, Mincong Huang, Jingyang…