Summary of On the Role Of Activation Functions in Eeg-to-text Decoder, by Zenon Lamprou et al.
On the Role of Activation Functions in EEG-To-Text Decoderby Zenon Lamprou, Iakovos Tenedios, Yashar MoshfeghiFirst…
Summary of The Persian Rug: Solving Toy Models Of Superposition Using Large-scale Symmetries, by Aditya Cowsik et al.
The Persian Rug: solving toy models of superposition using large-scale symmetriesby Aditya Cowsik, Kfir Dolev,…
Summary of Actnas : Generating Efficient Yolo Models Using Activation Nas, by Sudhakar Sah et al.
ActNAS : Generating Efficient YOLO Models using Activation NASby Sudhakar Sah, Ravish Kumar, Darshan C.…
Summary of Non-convergence to Global Minimizers in Data Driven Supervised Deep Learning: Adam and Stochastic Gradient Descent Optimization Provably Fail to Converge to Global Minimizers in the Training Of Deep Neural Networks with Relu Activation, by Thang Do and Sonja Hannibal and Arnulf Jentzen
Non-convergence to global minimizers in data driven supervised deep learning: Adam and stochastic gradient descent…
Summary of Feature Averaging: An Implicit Bias Of Gradient Descent Leading to Non-robustness in Neural Networks, by Binghui Li et al.
Feature Averaging: An Implicit Bias of Gradient Descent Leading to Non-Robustness in Neural Networksby Binghui…
Summary of Relu’s Revival: on the Entropic Overload in Normalization-free Large Language Models, by Nandan Kumar Jha and Brandon Reagen
ReLU’s Revival: On the Entropic Overload in Normalization-Free Large Language Modelsby Nandan Kumar Jha, Brandon…
Summary of Looped Relu Mlps May Be All You Need As Practical Programmable Computers, by Yingyu Liang et al.
Looped ReLU MLPs May Be All You Need as Practical Programmable Computersby Yingyu Liang, Zhizhou…
Summary of Adversarial Training Can Provably Improve Robustness: Theoretical Analysis Of Feature Learning Process Under Structured Data, by Binghui Li et al.
Adversarial Training Can Provably Improve Robustness: Theoretical Analysis of Feature Learning Process Under Structured Databy…
Summary of Provable Privacy Attacks on Trained Shallow Neural Networks, by Guy Smorodinsky and Gal Vardi and Itay Safran
Provable Privacy Attacks on Trained Shallow Neural Networksby Guy Smorodinsky, Gal Vardi, Itay SafranFirst submitted…
Summary of On the Expressiveness Of Multi-neuron Convex Relaxations, by Yuhao Mao et al.
On the Expressiveness of Multi-Neuron Convex Relaxationsby Yuhao Mao, Yani Zhang, Martin VechevFirst submitted to…