Summary of Unitnorm: Rethinking Normalization For Transformers in Time Series, by Nan Huang et al.
UnitNorm: Rethinking Normalization for Transformers in Time Seriesby Nan Huang, Christian Kümmerle, Xiang ZhangFirst submitted…
Summary of Infinite Limits Of Multi-head Transformer Dynamics, by Blake Bordelon et al.
Infinite Limits of Multi-head Transformer Dynamicsby Blake Bordelon, Hamza Tahir Chaudhry, Cengiz PehlevanFirst submitted to…
Summary of Models That Prove Their Own Correctness, by Noga Amit et al.
Models That Prove Their Own Correctnessby Noga Amit, Shafi Goldwasser, Orr Paradise, Guy RothblumFirst submitted…
Summary of Filtered Corpus Training (fict) Shows That Language Models Can Generalize From Indirect Evidence, by Abhinav Patil and Jaap Jumelet and Yu Ying Chiu and Andy Lapastora and Peter Shen and Lexie Wang and Clevis Willrich and Shane Steinert-threlkeld
Filtered Corpus Training (FiCT) Shows that Language Models can Generalize from Indirect Evidenceby Abhinav Patil,…
Summary of Sequence Length Scaling in Vision Transformers For Scientific Images on Frontier, by Aristeidis Tsaris et al.
Sequence Length Scaling in Vision Transformers for Scientific Images on Frontierby Aristeidis Tsaris, Chengming Zhang,…
Summary of Mlps Learn In-context on Regression and Classification Tasks, by William L. Tong and Cengiz Pehlevan
MLPs Learn In-Context on Regression and Classification Tasksby William L. Tong, Cengiz PehlevanFirst submitted to…
Summary of Spectraformer: a Unified Random Feature Framework For Transformer, by Duke Nguyen et al.
Spectraformer: A Unified Random Feature Framework for Transformerby Duke Nguyen, Aditya Joshi, Flora SalimFirst submitted…
Summary of Ivideogpt: Interactive Videogpts Are Scalable World Models, by Jialong Wu et al.
iVideoGPT: Interactive VideoGPTs are Scalable World Modelsby Jialong Wu, Shaofeng Yin, Ningya Feng, Xu He,…
Summary of The Buffer Mechanism For Multi-step Information Reasoning in Language Models, by Zhiwei Wang et al.
The Buffer Mechanism for Multi-Step Information Reasoning in Language Modelsby Zhiwei Wang, Yunji Wang, Zhongwang…
Summary of Towards Better Understanding Of In-context Learning Ability From In-context Uncertainty Quantification, by Shang Liu et al.
Towards Better Understanding of In-Context Learning Ability from In-Context Uncertainty Quantificationby Shang Liu, Zhongze Cai,…