Summary of Mechanism and Emergence Of Stacked Attention Heads in Multi-layer Transformers, by Tiberiu Musat
Mechanism and Emergence of Stacked Attention Heads in Multi-Layer Transformersby Tiberiu MusatFirst submitted to arxiv…
Summary of St-tree with Interpretability For Multivariate Time Series Classification, by Mingsen Du et al.
ST-Tree with Interpretability for Multivariate Time Series Classificationby Mingsen Du, Yanxuan Wei, Yingxia Tang, Xiangwei…
Summary of Continual Task Learning Through Adaptive Policy Self-composition, by Shengchao Hu et al.
Continual Task Learning through Adaptive Policy Self-Compositionby Shengchao Hu, Yuhang Zhou, Ziqing Fan, Jifeng Hu,…
Summary of Unveiling the Inflexibility Of Adaptive Embedding in Traffic Forecasting, by Hongjun Wang et al.
Unveiling the Inflexibility of Adaptive Embedding in Traffic Forecastingby Hongjun Wang, Jiyuan Chen, Lingyu Zhang,…
Summary of Re-examining Learning Linear Functions in Context, by Omar Naim et al.
Re-examining learning linear functions in contextby Omar Naim, Guilhem Fouilhé, Nicholas AsherFirst submitted to arxiv…
Summary of Enhancing Decision Transformer with Diffusion-based Trajectory Branch Generation, by Zhihong Liu et al.
Enhancing Decision Transformer with Diffusion-Based Trajectory Branch Generationby Zhihong Liu, Long Qian, Zeyang Liu, Lipeng…
Summary of Knowledge-enhanced Transformer For Multivariate Long Sequence Time-series Forecasting, by Shubham Tanaji Kakde et al.
Knowledge-enhanced Transformer for Multivariate Long Sequence Time-series Forecastingby Shubham Tanaji Kakde, Rony Mitra, Jasashwi Mandal,…
Summary of Conformation Generation Using Transformer Flows, by Sohil Atul Shah and Vladlen Koltun
Conformation Generation using Transformer Flowsby Sohil Atul Shah, Vladlen KoltunFirst submitted to arxiv on: 16…
Summary of One-layer Transformer Provably Learns One-nearest Neighbor in Context, by Zihao Li et al.
One-Layer Transformer Provably Learns One-Nearest Neighbor In Contextby Zihao Li, Yuan Cao, Cheng Gao, Yihan…
Summary of Hybrid Attention Model Using Feature Decomposition and Knowledge Distillation For Glucose Forecasting, by Ebrahim Farahmand et al.
Hybrid Attention Model Using Feature Decomposition and Knowledge Distillation for Glucose Forecastingby Ebrahim Farahmand, Shovito…