Todyformer: Towards Holistic Dynamic Graph Transformers with Structure-Aware Tokenizationby Mahdi Biparva, Raika Karimi, Faezeh Faez,…
A Hyper-Transformer model for Controllable Pareto Front Learning with Split Feasibility Constraintsby Tran Anh Tuan,…
Limits of Transformer Language Models on Learning to Compose Algorithmsby Jonathan Thomm, Giacomo Camposampiero, Aleksandar…
How do Transformers perform In-Context Autoregressive Learning?by Michael E. Sander, Raja Giryes, Taiji Suzuki, Mathieu…
Sparse-VQ Transformer: An FFN-Free Framework with Vector Quantization for Enhanced Time Series Forecastingby Yanjun Zhao,…
Large Language Model Meets Graph Neural Network in Knowledge Distillationby Shengxiang Hu, Guobing Zou, Song…
RepQuant: Towards Accurate Post-Training Quantization of Large Transformer Models via Scale Reparameterizationby Zhikai Li, Xuewen…
AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformersby Reduan Achtibat, Sayed Mohammad Vakilzadeh Hatefi, Maximilian Dreyer,…
Attention as Robust Representation for Time Series Forecastingby PeiSong Niu, Tian Zhou, Xue Wang, Liang…
Do Transformer World Models Give Better Policy Gradients?by Michel Ma, Tianwei Ni, Clement Gehring, Pierluca…