Summary of Ngd Converges to Less Degenerate Solutions Than Sgd, by Moosa Saghir et al.
NGD converges to less degenerate solutions than SGDby Moosa Saghir, N. R. Raghavendra, Zihe Liu,…
Summary of Enhancing Deep Learning with Optimized Gradient Descent: Bridging Numerical Methods and Neural Network Training, by Yuhan Ma et al.
Enhancing Deep Learning with Optimized Gradient Descent: Bridging Numerical Methods and Neural Network Trainingby Yuhan…
Summary of Improving Adaptivity Via Over-parameterization in Sequence Models, by Yicheng Li et al.
Improving Adaptivity via Over-Parameterization in Sequence Modelsby Yicheng Li, Qian LinFirst submitted to arxiv on:…
Summary of Ensloss: Stochastic Calibrated Loss Ensembles For Preventing Overfitting in Classification, by Ben Dai
EnsLoss: Stochastic Calibrated Loss Ensembles for Preventing Overfitting in Classificationby Ben DaiFirst submitted to arxiv…