Summary of Topology-informed Graph Transformer, by Yun Young Choi et al.
Topology-Informed Graph Transformerby Yun Young Choi, Sun Woo Park, Minho Lee, Youngho WooFirst submitted to…
Summary of Tricy: Trigger-guided Data-to-text Generation with Intent Aware Attention-copy, by Vibhav Agarwal et al.
TrICy: Trigger-guided Data-to-text Generation with Intent aware Attention-Copyby Vibhav Agarwal, Sourav Ghosh, Harichandana BSS, Himanshu…
Summary of Language-guided World Models: a Model-based Approach to Ai Control, by Alex Zhang et al.
Language-Guided World Models: A Model-Based Approach to AI Controlby Alex Zhang, Khanh Nguyen, Jens Tuyls,…
Summary of Self-attention Through Kernel-eigen Pair Sparse Variational Gaussian Processes, by Yingyi Chen et al.
Self-Attention through Kernel-Eigen Pair Sparse Variational Gaussian Processesby Yingyi Chen, Qinghua Tao, Francesco Tonin, Johan…
Summary of Transformers Learn Nonlinear Features in Context: Nonconvex Mean-field Dynamics on the Attention Landscape, by Juno Kim and Taiji Suzuki
Transformers Learn Nonlinear Features In Context: Nonconvex Mean-field Dynamics on the Attention Landscapeby Juno Kim,…
Summary of Simulation Of Graph Algorithms with Looped Transformers, by Artur Back De Luca and Kimon Fountoulakis
Simulation of Graph Algorithms with Looped Transformersby Artur Back de Luca, Kimon FountoulakisFirst submitted to…
Summary of Dense Reward For Free in Reinforcement Learning From Human Feedback, by Alex J. Chan et al.
Dense Reward for Free in Reinforcement Learning from Human Feedbackby Alex J. Chan, Hao Sun,…
Summary of Theoretical Understanding Of In-context Learning in Shallow Transformers with Unstructured Data, by Yue Xing et al.
Theoretical Understanding of In-Context Learning in Shallow Transformers with Unstructured Databy Yue Xing, Xiaofeng Lin,…
Summary of Understanding the Expressive Power and Mechanisms Of Transformer For Sequence Modeling, by Mingze Wang et al.
Understanding the Expressive Power and Mechanisms of Transformer for Sequence Modelingby Mingze Wang, Weinan EFirst…
Summary of A Manifold Representation Of the Key in Vision Transformers, by Li Meng et al.
A Manifold Representation of the Key in Vision Transformersby Li Meng, Morten Goodwin, Anis Yazidi,…