Summary of Decentralized Optimization in Time-varying Networks with Arbitrary Delays, by Tomas Ortega et al.
Decentralized Optimization in Time-Varying Networks with Arbitrary Delaysby Tomas Ortega, Hamid JafarkhaniFirst submitted to arxiv…
Summary of Learning to Continually Learn with the Bayesian Principle, by Soochan Lee et al.
Learning to Continually Learn with the Bayesian Principleby Soochan Lee, Hyeonseong Jeon, Jaehyeon Son, Gunhee…
Summary of The Unified Balance Theory Of Second-moment Exponential Scaling Optimizers in Visual Tasks, by Gongyue Zhang and Honghai Liu
The Unified Balance Theory of Second-Moment Exponential Scaling Optimizers in Visual Tasksby Gongyue Zhang, Honghai…
Summary of A Hessian-aware Stochastic Differential Equation For Modelling Sgd, by Xiang Li et al.
A Hessian-Aware Stochastic Differential Equation for Modelling SGDby Xiang Li, Zebang Shen, Liang Zhang, Niao…
Summary of Adaptive Debiased Sgd in High-dimensional Glms with Streaming Data, by Ruijian Han et al.
Adaptive debiased SGD in high-dimensional GLMs with streaming databy Ruijian Han, Lan Luo, Yuanhang Luo,…
Summary of Bias in Motion: Theoretical Insights Into the Dynamics Of Bias in Sgd Training, by Anchit Jain et al.
Bias in Motion: Theoretical Insights into the Dynamics of Bias in SGD Trainingby Anchit Jain,…
Summary of Understanding Forgetting in Continual Learning with Linear Regression, by Meng Ding et al.
Understanding Forgetting in Continual Learning with Linear Regressionby Meng Ding, Kaiyi Ji, Di Wang, Jinhui…
Summary of Matrix Low-rank Approximation For Policy Gradient Methods, by Sergio Rozada and Antonio G. Marques
Matrix Low-Rank Approximation For Policy Gradient Methodsby Sergio Rozada, Antonio G. MarquesFirst submitted to arxiv…
Summary of Clip Body and Tail Separately: High Probability Guarantees For Dpsgd with Heavy Tails, by Haichao Sha and Yang Cao and Yong Liu and Yuncheng Wu and Ruixuan Liu and Hong Chen
Clip Body and Tail Separately: High Probability Guarantees for DPSGD with Heavy Tailsby Haichao Sha,…
Summary of Dual-delayed Asynchronous Sgd For Arbitrarily Heterogeneous Data, by Xiaolu Wang et al.
Dual-Delayed Asynchronous SGD for Arbitrarily Heterogeneous Databy Xiaolu Wang, Yuchang Sun, Hoi-To Wai, Jun ZhangFirst…