Summary of On the Learn-to-optimize Capabilities Of Transformers in In-context Sparse Recovery, by Renpu Liu et al.
On the Learn-to-Optimize Capabilities of Transformers in In-Context Sparse Recoveryby Renpu Liu, Ruida Zhou, Cong…
Summary of Low-rank Adversarial Pgd Attack, by Dayana Savostianova et al.
Low-Rank Adversarial PGD Attackby Dayana Savostianova, Emanuele Zangrando, Francesco TudiscoFirst submitted to arxiv on: 16…
Summary of State-space Models Can Learn In-context by Gradient Descent, By Neeraj Mohan Sushma et al.
State-space models can learn in-context by gradient descentby Neeraj Mohan Sushma, Yudou Tian, Harshvardhan Mestha,…
Summary of On the Training Convergence Of Transformers For In-context Classification Of Gaussian Mixtures, by Wei Shen et al.
On the Training Convergence of Transformers for In-Context Classification of Gaussian Mixturesby Wei Shen, Ruida…
Summary of Beyond Linear Approximations: a Novel Pruning Approach For Attention Matrix, by Yingyu Liang et al.
Beyond Linear Approximations: A Novel Pruning Approach for Attention Matrixby Yingyu Liang, Jiangxuan Long, Zhenmei…
Summary of Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent, By Bo Chen et al.
Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descentby Bo Chen,…
Summary of Fast Second-order Online Kernel Learning Through Incremental Matrix Sketching and Decomposition, by Dongxie Wen et al.
Fast Second-Order Online Kernel Learning through Incremental Matrix Sketching and Decompositionby Dongxie Wen, Xiao Zhang,…
Summary of Rosar: An Adversarial Re-training Framework For Robust Side-scan Sonar Object Detection, by Martin Aubard et al.
ROSAR: An Adversarial Re-Training Framework for Robust Side-Scan Sonar Object Detectionby Martin Aubard, László Antal,…
Summary of Robust Gradient Descent For Phase Retrieval, by Alex Buna et al.
Robust Gradient Descent for Phase Retrievalby Alex Buna, Patrick RebeschiniFirst submitted to arxiv on: 14…
Summary of Feature Averaging: An Implicit Bias Of Gradient Descent Leading to Non-robustness in Neural Networks, by Binghui Li et al.
Feature Averaging: An Implicit Bias of Gradient Descent Leading to Non-Robustness in Neural Networksby Binghui…