Summary of Teaching Mlp More Graph Information: a Three-stage Multitask Knowledge Distillation Framework, by Junxian Li et al.
Teaching MLP More Graph Information: A Three-stage Multitask Knowledge Distillation Frameworkby Junxian Li, Bin Shi,…
Summary of Comparing Graph Transformers Via Positional Encodings, by Mitchell Black et al.
Comparing Graph Transformers via Positional Encodingsby Mitchell Black, Zhengchao Wan, Gal Mishne, Amir Nayyeri, Yusu…
Summary of From Self-attention to Markov Models: Unveiling the Dynamics Of Generative Transformers, by M. Emrullah Ildiz et al.
From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformersby M. Emrullah Ildiz, Yixiao…
Summary of Polyhedral Complex Derivation From Piecewise Trilinear Networks, by Jin-hwa Kim
Polyhedral Complex Derivation from Piecewise Trilinear Networksby Jin-Hwa KimFirst submitted to arxiv on: 16 Feb…
Summary of Subgraphormer: Unifying Subgraph Gnns and Graph Transformers Via Graph Products, by Guy Bar-shalom et al.
Subgraphormer: Unifying Subgraph GNNs and Graph Transformers via Graph Productsby Guy Bar-Shalom, Beatrice Bevilacqua, Haggai…
Summary of Todyformer: Towards Holistic Dynamic Graph Transformers with Structure-aware Tokenization, by Mahdi Biparva et al.
Todyformer: Towards Holistic Dynamic Graph Transformers with Structure-Aware Tokenizationby Mahdi Biparva, Raika Karimi, Faezeh Faez,…
Summary of How Do Transformers Perform In-context Autoregressive Learning?, by Michael E. Sander et al.
How do Transformers perform In-Context Autoregressive Learning?by Michael E. Sander, Raja Giryes, Taiji Suzuki, Mathieu…
Summary of Xtsformer: Cross-temporal-scale Transformer For Irregular-time Event Prediction in Clinical Applications, by Tingsong Xiao et al.
XTSFormer: Cross-Temporal-Scale Transformer for Irregular-Time Event Prediction in Clinical Applicationsby Tingsong Xiao, Zelin Xu, Wenchong…
Summary of Beyond the Limits: a Survey Of Techniques to Extend the Context Length in Large Language Models, by Xindi Wang et al.
Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language…
Summary of Theoretical Understanding Of In-context Learning in Shallow Transformers with Unstructured Data, by Yue Xing et al.
Theoretical Understanding of In-Context Learning in Shallow Transformers with Unstructured Databy Yue Xing, Xiaofeng Lin,…