Summary of Generalization Vs. Memorization in the Presence Of Statistical Biases in Transformers, by John Mitros
Generalization vs. Memorization in the Presence of Statistical Biases in Transformersby John MitrosFirst submitted to arxiv…
Summary of Theory, Analysis, and Best Practices For Sigmoid Self-attention, by Jason Ramapuram et al.
Theory, Analysis, and Best Practices for Sigmoid Self-Attentionby Jason Ramapuram, Federico Danieli, Eeshan Dhekane, Floris…
Summary of Residual Stream Analysis with Multi-layer Saes, by Tim Lawson et al.
Residual Stream Analysis with Multi-Layer SAEsby Tim Lawson, Lucy Farnik, Conor Houghton, Laurence AitchisonFirst submitted…
Summary of Leveraging Interpretability in the Transformer to Automate the Proactive Scaling Of Cloud Resources, by Amadou Ba et al.
Leveraging Interpretability in the Transformer to Automate the Proactive Scaling of Cloud Resourcesby Amadou Ba,…
Summary of Probing Self-attention in Self-supervised Speech Models For Cross-linguistic Differences, by Sai Gopinath and Joselyn Rodriguez
Probing self-attention in self-supervised speech models for cross-linguistic differencesby Sai Gopinath, Joselyn RodriguezFirst submitted to…
Summary of Addressing the Gaps in Early Dementia Detection: a Path Towards Enhanced Diagnostic Models Through Machine Learning, by Juan A. Berrios Moya
Addressing the Gaps in Early Dementia Detection: A Path Towards Enhanced Diagnostic Models through Machine…
Summary of Decision Transformer For Enhancing Neural Local Search on the Job Shop Scheduling Problem, by Constantin Waubert De Puiseau et al.
Decision Transformer for Enhancing Neural Local Search on the Job Shop Scheduling Problemby Constantin Waubert…
Summary of Timedit: General-purpose Diffusion Transformers For Time Series Foundation Model, by Defu Cao et al.
TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Modelby Defu Cao, Wen Ye, Yizhou Zhang,…
Summary of The Role Of Transformer Models in Advancing Blockchain Technology: a Systematic Survey, by Tianxu Liu et al.
The Role of Transformer Models in Advancing Blockchain Technology: A Systematic Surveyby Tianxu Liu, Yanbin…
Summary of Unforgettable Generalization in Language Models, by Eric Zhang et al.
Unforgettable Generalization in Language Modelsby Eric Zhang, Leshem Chosen, Jacob AndreasFirst submitted to arxiv on:…