Summary of Transformers to Predict the Applicability Of Symbolic Integration Routines, by Rashid Barket et al.
Transformers to Predict the Applicability of Symbolic Integration Routinesby Rashid Barket, Uzma Shafiq, Matthew England,…
Summary of Tract: Making First-layer Pre-activations Trainable, by Felix Petersen et al.
TrAct: Making First-layer Pre-Activations Trainableby Felix Petersen, Christian Borgelt, Stefano ErmonFirst submitted to arxiv on:…
Summary of Lseattention Is All You Need For Time Series Forecasting, by Dizhen Liang
LSEAttention is All You Need for Time Series Forecastingby Dizhen LiangFirst submitted to arxiv on:…
Summary of Return Augmented Decision Transformer For Off-dynamics Reinforcement Learning, by Ruhan Wang et al.
Return Augmented Decision Transformer for Off-Dynamics Reinforcement Learningby Ruhan Wang, Yu Yang, Zhishuai Liu, Dongruo…
Summary of The Belief State Transformer, by Edward S. Hu et al.
The Belief State Transformerby Edward S. Hu, Kwangjun Ahn, Qinghua Liu, Haoran Xu, Manan Tomar,…
Summary of Generative Forecasting Of Brain Activity Enhances Alzheimer’s Classification and Interpretation, by Yutong Gao et al.
Generative forecasting of brain activity enhances Alzheimer’s classification and interpretationby Yutong Gao, Vince D. Calhoun,…
Summary of Learning and Transferring Sparse Contextual Bigrams with Linear Transformers, by Yunwei Ren et al.
Learning and Transferring Sparse Contextual Bigrams with Linear Transformersby Yunwei Ren, Zixuan Wang, Jason D.…
Summary of Tokenformer: Rethinking Transformer Scaling with Tokenized Model Parameters, by Haiyang Wang et al.
TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parametersby Haiyang Wang, Yue Fan, Muhammad Ferjad Naeem,…
Summary of Does Equivariance Matter at Scale?, by Johann Brehmer et al.
Does equivariance matter at scale?by Johann Brehmer, Sönke Behrends, Pim de Haan, Taco CohenFirst submitted…
Summary of Protransformer: Robustify Transformers Via Plug-and-play Paradigm, by Zhichao Hou et al.
ProTransformer: Robustify Transformers via Plug-and-Play Paradigmby Zhichao Hou, Weizhi Gao, Yuchen Shen, Feiyi Wang, Xiaorui…