Summary of Mamba-ptq: Outlier Channels in Recurrent Large Language Models, by Alessandro Pierro et al.
Mamba-PTQ: Outlier Channels in Recurrent Large Language Modelsby Alessandro Pierro, Steven AbreuFirst submitted to arxiv…
Summary of Team Up Gbdts and Dnns: Advancing Efficient and Effective Tabular Prediction with Tree-hybrid Mlps, by Jiahuan Yan et al.
Team up GBDTs and DNNs: Advancing Efficient and Effective Tabular Prediction with Tree-hybrid MLPsby Jiahuan…
Summary of Diversifying the Expert Knowledge For Task-agnostic Pruning in Sparse Mixture-of-experts, by Zeliang Zhang et al.
Diversifying the Expert Knowledge for Task-Agnostic Pruning in Sparse Mixture-of-Expertsby Zeliang Zhang, Xiaodong Liu, Hao…
Summary of Weight Block Sparsity: Training, Compilation, and Ai Engine Accelerators, by Paolo D’alberto et al.
Weight Block Sparsity: Training, Compilation, and AI Engine Acceleratorsby Paolo D'Alberto, Taehee Jeong, Akshai Jain,…
Summary of Automatic Pruning Of Fine-tuning Datasets For Transformer-based Language Models, by Mohammadreza Tayaranian et al.
Automatic Pruning of Fine-tuning Datasets for Transformer-based Language Modelsby Mohammadreza Tayaranian, Seyyed Hasan Mozafari, Brett…
Summary of Characterizing Prompt Compression Methods For Long Context Inference, by Siddharth Jha et al.
Characterizing Prompt Compression Methods for Long Context Inferenceby Siddharth Jha, Lutfi Eren Erdogan, Sehoon Kim,…
Summary of Explaining Graph Neural Networks For Node Similarity on Graphs, by Daniel Daza et al.
Explaining Graph Neural Networks for Node Similarity on Graphsby Daniel Daza, Cuong Xuan Chu, Trung-Kien…
Summary of Graph Anomaly Detection with Noisy Labels by Reinforcement Learning, By Zhu Wang et al.
Graph Anomaly Detection with Noisy Labels by Reinforcement Learningby Zhu Wang, Shuang Zhou, Junnan Dong,…
Summary of Pruning One More Token Is Enough: Leveraging Latency-workload Non-linearities For Vision Transformers on the Edge, by Nick John Eliopoulos et al.
Pruning One More Token is Enough: Leveraging Latency-Workload Non-Linearities for Vision Transformers on the Edgeby…
Summary of Dmtg: One-shot Differentiable Multi-task Grouping, by Yuan Gao and Shuguo Jiang and Moran Li and Jin-gang Yu and Gui-song Xia
DMTG: One-Shot Differentiable Multi-Task Groupingby Yuan Gao, Shuguo Jiang, Moran Li, Jin-Gang Yu, Gui-Song XiaFirst…