Summary of More Expressive Attention with Negative Weights, by Ang Lv et al.
More Expressive Attention with Negative Weightsby Ang Lv, Ruobing Xie, Shuaipeng Li, Jiayi Liao, Xingwu…
Summary of Structure Matters: Dynamic Policy Gradient, by Sara Klein et al.
Structure Matters: Dynamic Policy Gradientby Sara Klein, Xiangyuan Zhang, Tamer Başar, Simon Weissmann, Leif DöringFirst…
Summary of Impact Of White Noise in Artificial Neural Networks Trained For Classification: Performance and Noise Mitigation Strategies, by Nadezhda Semenova and Daniel Brunner
Impact of white noise in artificial neural networks trained for classification: performance and noise mitigation…
Summary of Laser: Attention with Exponential Transformation, by Sai Surya Duvvuri et al.
LASER: Attention with Exponential Transformationby Sai Surya Duvvuri, Inderjit S. DhillonFirst submitted to arxiv on:…
Summary of Psl: Rethinking and Improving Softmax Loss From Pairwise Perspective For Recommendation, by Weiqin Yang et al.
PSL: Rethinking and Improving Softmax Loss from Pairwise Perspective for Recommendationby Weiqin Yang, Jiawei Chen,…
Summary of Joint Training For Selective Prediction, by Zhaohui Li et al.
Joint Training for Selective Predictionby Zhaohui Li, Rebecca J. PassonneauFirst submitted to arxiv on: 31…
Summary of Rethinking Softmax: Self-attention with Polynomial Activations, by Hemanth Saratchandran et al.
Rethinking Softmax: Self-Attention with Polynomial Activationsby Hemanth Saratchandran, Jianqiao Zheng, Yiping Ji, Wenbo Zhang, Simon…
Summary of Stick-breaking Attention, by Shawn Tan et al.
Stick-breaking Attentionby Shawn Tan, Yikang Shen, Songlin Yang, Aaron Courville, Rameswar PandaFirst submitted to arxiv…
Summary of Methods Of Improving Llm Training Stability, by Oleg Rybakov et al.
Methods of improving LLM training stabilityby Oleg Rybakov, Mike Chrzanowski, Peter Dykas, Jinze Xue, Ben…
Summary of Calibration Of Ordinal Regression Networks, by Daehwan Kim et al.
Calibration of Ordinal Regression Networksby Daehwan Kim, Haejun Chung, Ikbeom JangFirst submitted to arxiv on:…