Summary of Magnitude Pruning Of Large Pretrained Transformer Models with a Mixture Gaussian Prior, by Mingxuan Zhang et al.
Magnitude Pruning of Large Pretrained Transformer Models with a Mixture Gaussian Priorby Mingxuan Zhang, Yan…
Summary of Automated Global Analysis Of Experimental Dynamics Through Low-dimensional Linear Embeddings, by Samuel A. Moore et al.
Automated Global Analysis of Experimental Dynamics through Low-Dimensional Linear Embeddingsby Samuel A. Moore, Brian P.…
Summary of Preventing Model Collapse in Deep Canonical Correlation Analysis by Noise Regularization, By Junlin He et al.
Preventing Model Collapse in Deep Canonical Correlation Analysis by Noise Regularizationby Junlin He, Jinxiao Du,…
Summary of Preventing Dimensional Collapse in Self-supervised Learning Via Orthogonality Regularization, by Junlin He et al.
Preventing Dimensional Collapse in Self-Supervised Learning via Orthogonality Regularizationby Junlin He, Jinxiao Du, Wei MaFirst…
Summary of Improving Few-shot Cross-domain Named Entity Recognition by Instruction Tuning a Word-embedding Based Retrieval Augmented Large Language Model, By Subhadip Nandi and Neeraj Agrawal
Improving Few-Shot Cross-Domain Named Entity Recognition by Instruction Tuning a Word-Embedding based Retrieval Augmented Large…
Summary of Understanding Optimization in Deep Learning with Central Flows, by Jeremy M. Cohen and Alex Damian and Ameet Talwalkar and Zico Kolter and Jason D. Lee
Understanding Optimization in Deep Learning with Central Flowsby Jeremy M. Cohen, Alex Damian, Ameet Talwalkar,…
Summary of Weight Decay Induces Low-rank Attention Layers, by Seijin Kobayashi et al.
Weight decay induces low-rank attention layersby Seijin Kobayashi, Yassir Akram, Johannes Von OswaldFirst submitted to…
Summary of Global Convergence in Training Large-scale Transformers, by Cheng Gao and Yuan Cao and Zihao Li and Yihan He and Mengdi Wang and Han Liu and Jason Matthew Klusowski and Jianqing Fan
Global Convergence in Training Large-Scale Transformersby Cheng Gao, Yuan Cao, Zihao Li, Yihan He, Mengdi…
Summary of Sequential Order-robust Mamba For Time Series Forecasting, by Seunghan Lee et al.
Sequential Order-Robust Mamba for Time Series Forecastingby Seunghan Lee, Juri Hong, Kibok Lee, Taeyoung ParkFirst…
Summary of The Persistence Of Neural Collapse Despite Low-rank Bias: An Analytic Perspective Through Unconstrained Features, by Connall Garrod and Jonathan P. Keating
The Persistence of Neural Collapse Despite Low-Rank Bias: An Analytic Perspective Through Unconstrained Featuresby Connall…