Enhancing Transformer-based models for Long Sequence Time Series Forecasting via Structured Matrixby Zhicheng Zhang, Yong…
Distinguished In Uniform: Self Attention Vs. Virtual Nodesby Eran Rosenbluth, Jan Tönshoff, Martin Ritzert, Berke…
Sparse Attention-driven Quality Prediction for Production Process Optimization in Digital Twinsby Yanlei Yin, Lihua Wang,…
Action Controlled Paraphrasingby Ning Shi, Zijun WuFirst submitted to arxiv on: 18 May 2024CategoriesMain: Computation…
Block Selective Reprogramming for On-device Training of Vision Transformersby Sreetama Sarkar, Souvik Kundu, Kai Zheng,…
Smart Sampling: Self-Attention and Bootstrapping for Improved Ensembled Q-Learningby Muhammad Junaid Khan, Syed Hammad Ahmed,…
Simple Drop-in LoRA Conditioning on Attention Layers Will Improve Your Diffusion Modelby Joo Young Choi,…
AnchorGT: Efficient and Flexible Attention Architecture for Scalable Graph Transformersby Wenhao Zhu, Guojie Song, Liang…
Exploring prompts to elicit memorization in masked language model-based named entity recognitionby Yuxi Xia, Anastasiia…
IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUsby Yuzhen Mao, Martin Ester, Ke LiFirst submitted…