Summary of Geoadaler: Geometric Insights Into Adaptive Stochastic Gradient Descent Algorithms, by Chinedu Eleh et al.
GeoAdaLer: Geometric Insights into Adaptive Stochastic Gradient Descent Algorithmsby Chinedu Eleh, Masuzyo Mwanza, Ekene Aguegboh,…
Summary of 4+3 Phases Of Compute-optimal Neural Scaling Laws, by Elliot Paquette et al.
4+3 Phases of Compute-Optimal Neural Scaling Lawsby Elliot Paquette, Courtney Paquette, Lechao Xiao, Jeffrey PenningtonFirst…
Summary of Banded Square Root Matrix Factorization For Differentially Private Model Training, by Nikita P. Kalinin et al.
Banded Square Root Matrix Factorization for Differentially Private Model Trainingby Nikita P. Kalinin, Christoph LampertFirst…
Summary of Almost Sure Convergence Rates Of Stochastic Gradient Methods Under Gradient Domination, by Simon Weissmann et al.
Almost sure convergence rates of stochastic gradient methods under gradient dominationby Simon Weissmann, Sara Klein,…
Summary of Score-based Generative Models with Adaptive Momentum, by Ziqing Wen et al.
Score-based Generative Models with Adaptive Momentumby Ziqing Wen, Xiaoge Deng, Ping Luo, Tao Sun, Dongsheng…
Summary of Uncertainty Quantification by Block Bootstrap For Differentially Private Stochastic Gradient Descent, By Holger Dette et al.
Uncertainty quantification by block bootstrap for differentially private stochastic gradient descentby Holger Dette, Carina GrawFirst…
Summary of Flattened One-bit Stochastic Gradient Descent: Compressed Distributed Optimization with Controlled Variance, by Alexander Stollenwerk and Laurent Jacques
Flattened one-bit stochastic gradient descent: compressed distributed optimization with controlled varianceby Alexander Stollenwerk, Laurent JacquesFirst…
Summary of Random Scaling and Momentum For Non-smooth Non-convex Optimization, by Qinzi Zhang et al.
Random Scaling and Momentum for Non-smooth Non-convex Optimizationby Qinzi Zhang, Ashok CutkoskyFirst submitted to arxiv…
Summary of Secure Aggregation Meets Sparsification in Decentralized Learning, by Sayan Biswas et al.
Secure Aggregation Meets Sparsification in Decentralized Learningby Sayan Biswas, Anne-Marie Kermarrec, Rafael Pires, Rishi Sharma,…
Summary of Valid: a Validated Algorithm For Learning in Decentralized Networks with Possible Adversarial Presence, by Mayank Bakshi et al.
VALID: a Validated Algorithm for Learning in Decentralized Networks with Possible Adversarial Presenceby Mayank Bakshi,…