Summary of Parallelizing Linear Transformers with the Delta Rule Over Sequence Length, by Songlin Yang et al.
Parallelizing Linear Transformers with the Delta Rule over Sequence Lengthby Songlin Yang, Bailin Wang, Yu…
Summary of Continuum Attention For Neural Operators, by Edoardo Calvello et al.
Continuum Attention for Neural Operatorsby Edoardo Calvello, Nikola B. Kovachki, Matthew E. Levine, Andrew M.…
Summary of Learning Physical Simulation with Message Passing Transformer, by Zeyi Xu and Yifei Li
Learning Physical Simulation with Message Passing Transformerby Zeyi Xu, Yifei LiFirst submitted to arxiv on:…
Summary of Attention As a Hypernetwork, by Simon Schug et al.
Attention as a Hypernetworkby Simon Schug, Seijin Kobayashi, Yassir Akram, João Sacramento, Razvan PascanuFirst submitted…
Summary of Decision Mamba: a Multi-grained State Space Model with Self-evolution Regularization For Offline Rl, by Qi Lv et al.
Decision Mamba: A Multi-Grained State Space Model with Self-Evolution Regularization for Offline RLby Qi Lv,…
Summary of G-transformer: Counterfactual Outcome Prediction Under Dynamic and Time-varying Treatment Regimes, by Hong Xiong et al.
G-Transformer: Counterfactual Outcome Prediction under Dynamic and Time-varying Treatment Regimesby Hong Xiong, Feng Wu, Leon…
Summary of Automata Extraction From Transformers, by Yihao Zhang et al.
Automata Extraction from Transformersby Yihao Zhang, Zeming Wei, Meng SunFirst submitted to arxiv on: 8…
Summary of Aligned at the Start: Conceptual Groupings in Llm Embeddings, by Mehrdad Khatir et al.
Aligned at the Start: Conceptual Groupings in LLM Embeddingsby Mehrdad Khatir, Sanchit Kabra, Chandan K.…
Summary of Transformer Conformal Prediction For Time Series, by Junghwan Lee et al.
Transformer Conformal Prediction for Time Seriesby Junghwan Lee, Chen Xu, Yao XieFirst submitted to arxiv…
Summary of Retrieval & Fine-tuning For In-context Tabular Models, by Valentin Thomas et al.
Retrieval & Fine-Tuning for In-Context Tabular Modelsby Valentin Thomas, Junwei Ma, Rasa Hosseinzadeh, Keyvan Golestan,…