DeformTime: Capturing Variable Dependencies with Deformable Attention for Time Series Forecastingby Yuxuan Shu, Vasileios LamposFirst…
When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Modelsby…
Identifiable Object-Centric Representation Learning via Probabilistic Slot Attentionby Avinash Kori, Francesco Locatello, Ainkaran Santhirasekaram, Francesca…
Improving Generalization of Neural Vehicle Routing Problem Solvers Through the Lens of Model Architectureby Yubin…
Understanding attention-based encoder-decoder networks: a case study with chess scoresheet recognitionby Sergio Y. Hayashi, Nina…
DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusionby Yilong Chen, Linhao Zhang,…
Parallelizing Linear Transformers with the Delta Rule over Sequence Lengthby Songlin Yang, Bailin Wang, Yu…
Continuum Attention for Neural Operatorsby Edoardo Calvello, Nikola B. Kovachki, Matthew E. Levine, Andrew M.…
Graph-Based Bidirectional Transformer Decision Threshold Adjustment Algorithm for Class-Imbalanced Molecular Databy Nicole Hayes, Ekaterina Merkurjev,…
Learning Physical Simulation with Message Passing Transformerby Zeyi Xu, Yifei LiFirst submitted to arxiv on:…