Summary of When Attention Sink Emerges in Language Models: An Empirical View, by Xiangming Gu et al.
When Attention Sink Emerges in Language Models: An Empirical Viewby Xiangming Gu, Tianyu Pang, Chao…
Summary of Towards Calibrated Losses For Adversarial Robust Reject Option Classification, by Vrund Shah et al.
Towards Calibrated Losses for Adversarial Robust Reject Option Classificationby Vrund Shah, Tejas Chaudhari, Naresh ManwaniFirst…
Summary of Nonuniform Random Feature Models Using Derivative Information, by Konstantin Pieper and Zezhong Zhang and Guannan Zhang
Nonuniform random feature models using derivative informationby Konstantin Pieper, Zezhong Zhang, Guannan ZhangFirst submitted to…
Summary of Is Uniform Expressivity Too Restrictive? Towards Efficient Expressivity Of Graph Neural Networks, by Sammy Khalife et al.
Is uniform expressivity too restrictive? Towards efficient expressivity of graph neural networksby Sammy Khalife, Josué…
Summary of Theory, Analysis, and Best Practices For Sigmoid Self-attention, by Jason Ramapuram et al.
Theory, Analysis, and Best Practices for Sigmoid Self-Attentionby Jason Ramapuram, Federico Danieli, Eeshan Dhekane, Floris…
Summary of On Expressive Power Of Quantized Neural Networks Under Fixed-point Arithmetic, by Geonho Hwang et al.
On Expressive Power of Quantized Neural Networks under Fixed-Point Arithmeticby Geonho Hwang, Yeachan Park, Sejun…
Summary of Artificial Neural Network and Deep Learning: Fundamentals and Theory, by M. M. Hammad
Artificial Neural Network and Deep Learning: Fundamentals and Theoryby M. M. HammadFirst submitted to arxiv…
Summary of Improving Nonlinear Projection Heads Using Pretrained Autoencoder Embeddings, by Andreas Schliebitz et al.
Improving Nonlinear Projection Heads using Pretrained Autoencoder Embeddingsby Andreas Schliebitz, Heiko Tapken, Martin AtzmuellerFirst submitted…