Summary of Learning K-u-net with Constant Complexity: An Application to Time Series Forecasting, by Jiang You et al.
Learning K-U-Net with constant complexity: An Application to time series forecastingby Jiang You, Arben Cela,…
Summary of Towards Better Generalization: Weight Decay Induces Low-rank Bias For Neural Networks, by Ke Chen et al.
Towards Better Generalization: Weight Decay Induces Low-rank Bias for Neural Networksby Ke Chen, Chugang Yi,…
Summary of Universality in Transfer Learning For Linear Models, by Reza Ghane et al.
Universality in Transfer Learning for Linear Modelsby Reza Ghane, Danil Akhtiamov, Babak HassibiFirst submitted to…
Summary of Review Non-convex Optimization Method For Machine Learning, by Greg B Fotopoulos et al.
Review Non-convex Optimization Method for Machine Learningby Greg B Fotopoulos, Paul Popovich, Nicholas Hall PapadopoulosFirst…
Summary of Truncated Kernel Stochastic Gradient Descent on Spheres, by Jinhui Bai et al.
Truncated Kernel Stochastic Gradient Descent on Spheresby Jinhui Bai, Lei ShiFirst submitted to arxiv on:…
Summary of Stochastic Gradient Descent with Adaptive Data, by Ethan Che and Jing Dong and Xin T. Tong
Stochastic Gradient Descent with Adaptive Databy Ethan Che, Jing Dong, Xin T. TongFirst submitted to…
Summary of Quantized and Asynchronous Federated Learning, by Tomas Ortega and Hamid Jafarkhani
Quantized and Asynchronous Federated Learningby Tomas Ortega, Hamid JafarkhaniFirst submitted to arxiv on: 30 Sep…
Summary of An Accelerated Algorithm For Stochastic Bilevel Optimization Under Unbounded Smoothness, by Xiaochuan Gong et al.
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothnessby Xiaochuan Gong, Jie Hao, Mingrui…
Summary of Reducing Bias in Deep Learning Optimization: the Rsgdm Approach, by Honglin Qin et al.
Reducing Bias in Deep Learning Optimization: The RSGDM Approachby Honglin Qin, Hongye Zheng, Bingxing Wang,…
Summary of Exploring Scaling Laws For Local Sgd in Large Language Model Training, by Qiaozhi He et al.
Exploring Scaling Laws for Local SGD in Large Language Model Trainingby Qiaozhi He, Xiaomin Zhuang,…