Summary of David and Goliath: An Empirical Evaluation Of Attacks and Defenses For Qnns at the Deep Edge, by Miguel Costa and Sandro Pinto
David and Goliath: An Empirical Evaluation of Attacks and Defenses for QNNs at the Deep…
Summary of What Happens When Small Is Made Smaller? Exploring the Impact Of Compression on Small Data Pretrained Language Models, by Busayo Awobade et al.
What Happens When Small Is Made Smaller? Exploring the Impact of Compression on Small Data…
Summary of Outlier-efficient Hopfield Layers For Large Transformer-based Models, by Jerry Yao-chieh Hu et al.
Outlier-Efficient Hopfield Layers for Large Transformer-Based Modelsby Jerry Yao-Chieh Hu, Pei-Hsuan Chang, Robin Luo, Hong-Yu…
Summary of Mitigating the Impact Of Outlier Channels For Language Model Quantization with Activation Regularization, by Aniruddha Nrusimha et al.
Mitigating the Impact of Outlier Channels for Language Model Quantization with Activation Regularizationby Aniruddha Nrusimha,…
Summary of Dnn Memory Footprint Reduction Via Post-training Intra-layer Multi-precision Quantization, by Behnam Ghavami et al.
DNN Memory Footprint Reduction via Post-Training Intra-Layer Multi-Precision Quantizationby Behnam Ghavami, Amin Kamjoo, Lesley Shannon,…
Summary of Pissa: Principal Singular Values and Singular Vectors Adaptation Of Large Language Models, by Fanxu Meng et al.
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Modelsby Fanxu Meng, Zhaohui…
Summary of Token-efficient Leverage Learning in Large Language Models, by Yuanhao Zeng et al.
Token-Efficient Leverage Learning in Large Language Modelsby Yuanhao Zeng, Min Wang, Yihang Wang, Yingxia ShaoFirst…
Summary of Instance-aware Group Quantization For Vision Transformers, by Jaehyeon Moon et al.
Instance-Aware Group Quantization for Vision Transformersby Jaehyeon Moon, Dohyung Kim, Junyong Cheon, Bumsub HamFirst submitted…
Summary of Quarot: Outlier-free 4-bit Inference in Rotated Llms, by Saleh Ashkboos et al.
QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMsby Saleh Ashkboos, Amirkeivan Mohtashami, Maximilian L. Croci, Bo…
Summary of Pikelpn: Mitigating Overlooked Inefficiencies Of Low-precision Neural Networks, by Marina Neseem et al.
PikeLPN: Mitigating Overlooked Inefficiencies of Low-Precision Neural Networksby Marina Neseem, Conor McCullough, Randy Hsin, Chas…