Summary of Copal: Continual Pruning in Large Language Generative Models, by Srikanth Malla et al.
COPAL: Continual Pruning in Large Language Generative Modelsby Srikanth Malla, Joon Hee Choi, Chiho ChoiFirst…
Summary of Early Transformers: a Study on Efficient Training Of Transformer Models Through Early-bird Lottery Tickets, by Shravan Cheekati
Early Transformers: A study on Efficient Training of Transformer Models through Early-Bird Lottery Ticketsby Shravan…
Summary of Dependency-aware Semi-structured Sparsity Of Glu Variants in Large Language Models, by Zhiyu Guo et al.
Dependency-Aware Semi-Structured Sparsity of GLU Variants in Large Language Modelsby Zhiyu Guo, Hidetaka Kamigaito, Taro…
Summary of A Separability-based Approach to Quantifying Generalization: Which Layer Is Best?, by Luciano Dyballa et al.
A separability-based approach to quantifying generalization: which layer is best?by Luciano Dyballa, Evan Gerritz, Steven…
Summary of Lotus: Improving Transformer Efficiency with Sparsity Pruning and Data Lottery Tickets, by Ojasw Upadhyay
LOTUS: Improving Transformer Efficiency with Sparsity Pruning and Data Lottery Ticketsby Ojasw UpadhyayFirst submitted to…
Summary of Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models, by Rishav Mukherji et al.
Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Modelsby Rishav Mukherji, Mark Schöne, Khaleelulla Khan…
Summary of Paoding: a High-fidelity Data-free Pruning Toolkit For Debloating Pre-trained Neural Networks, by Mark Huasong Meng et al.
PAODING: A High-fidelity Data-free Pruning Toolkit for Debloating Pre-trained Neural Networksby Mark Huasong Meng, Hao…
Summary of Nepenthe: Entropy-based Pruning As a Neural Network Depth’s Reducer, by Zhu Liao et al.
NEPENTHE: Entropy-Based Pruning as a Neural Network Depth’s Reducerby Zhu Liao, Victor Quétu, Van-Tam Nguyen,…
Summary of Rapid Deployment Of Dnns For Edge Computing Via Structured Pruning at Initialization, by Bailey J. Eccles et al.
Rapid Deployment of DNNs for Edge Computing via Structured Pruning at Initializationby Bailey J. Eccles,…
Summary of Learning Syntax Without Planting Trees: Understanding Hierarchical Generalization in Transformers, by Kabir Ahuja et al.
Learning Syntax Without Planting Trees: Understanding Hierarchical Generalization in Transformersby Kabir Ahuja, Vidhisha Balachandran, Madhur…