Summary of Anytime Acceleration Of Gradient Descent, by Zihan Zhang et al.
Anytime Acceleration of Gradient Descentby Zihan Zhang, Jason D. Lee, Simon S. Du, Yuxin ChenFirst…
Summary of Transformers Are Deep Optimizers: Provable In-context Learning For Deep Model Training, by Weimin Wu et al.
Transformers are Deep Optimizers: Provable In-Context Learning for Deep Model Trainingby Weimin Wu, Maojiang Su,…
Summary of Stability Properties Of Gradient Flow Dynamics For the Symmetric Low-rank Matrix Factorization Problem, by Hesameddin Mohammadi et al.
Stability properties of gradient flow dynamics for the symmetric low-rank matrix factorization problemby Hesameddin Mohammadi,…
Summary of Broad Critic Deep Actor Reinforcement Learning For Continuous Control, by Shiron Thalagala et al.
Broad Critic Deep Actor Reinforcement Learning for Continuous Controlby Shiron Thalagala, Pak Kin Wong, Xiaozheng…
Summary of Gradient Dynamics For Low-rank Fine-tuning Beyond Kernels, by Arif Kerem Dayi et al.
Gradient dynamics for low-rank fine-tuning beyond kernelsby Arif Kerem Dayi, Sitan ChenFirst submitted to arxiv…
Summary of Applications Of Fractional Calculus in Learned Optimization, by Teodor Alexandru Szente et al.
Applications of fractional calculus in learned optimizationby Teodor Alexandru Szente, James Harrison, Mihai Zanfir, Cristian…
Summary of Learning Differentiable Surrogate Losses For Structured Prediction, by Junjie Yang et al.
Learning Differentiable Surrogate Losses for Structured Predictionby Junjie Yang, Matthieu Labeau, Florence d'Alché-BucFirst submitted to…
Summary of One-layer Transformer Provably Learns One-nearest Neighbor in Context, by Zihao Li et al.
One-Layer Transformer Provably Learns One-Nearest Neighbor In Contextby Zihao Li, Yuan Cao, Cheng Gao, Yihan…
Summary of Unraveling the Gradient Descent Dynamics Of Transformers, by Bingqing Song et al.
Unraveling the Gradient Descent Dynamics of Transformersby Bingqing Song, Boran Han, Shuai Zhang, Jie Ding,…
Summary of Non-adversarial Inverse Reinforcement Learning Via Successor Feature Matching, by Arnav Kumar Jain et al.
Non-Adversarial Inverse Reinforcement Learning via Successor Feature Matchingby Arnav Kumar Jain, Harley Wiltzer, Jesse Farebrother,…