Summary of Algoformer: An Efficient Transformer Framework with Algorithmic Structures, by Yihang Gao et al.
AlgoFormer: An Efficient Transformer Framework with Algorithmic Structuresby Yihang Gao, Chuanyang Zheng, Enze Xie, Han…
Summary of Toward Transformers: Revolutionizing the Solution Of Mixed Integer Programs with Transformers, by Joshua F. Cooper et al.
Toward TransfORmers: Revolutionizing the Solution of Mixed Integer Programs with Transformersby Joshua F. Cooper, Seung…
Summary of Transformer Tricks: Precomputing the First Layer, by Nils Graef
Transformer tricks: Precomputing the first layerby Nils GraefFirst submitted to arxiv on: 20 Feb 2024CategoriesMain:…
Summary of Conditional Logical Message Passing Transformer For Complex Query Answering, by Chongzhi Zhang et al.
Conditional Logical Message Passing Transformer for Complex Query Answeringby Chongzhi Zhang, Zhiping Peng, Junhao Zheng,…
Summary of Backward Lens: Projecting Language Model Gradients Into the Vocabulary Space, by Shahar Katz et al.
Backward Lens: Projecting Language Model Gradients into the Vocabulary Spaceby Shahar Katz, Yonatan Belinkov, Mor…
Summary of Chain Of Thought Empowers Transformers to Solve Inherently Serial Problems, by Zhiyuan Li et al.
Chain of Thought Empowers Transformers to Solve Inherently Serial Problemsby Zhiyuan Li, Hong Liu, Denny…
Summary of An Equivariant Pretrained Transformer For Unified 3d Molecular Representation Learning, by Rui Jiao et al.
An Equivariant Pretrained Transformer for Unified 3D Molecular Representation Learningby Rui Jiao, Xiangzhe Kong, Li…
Summary of Beyond Uniform Scaling: Exploring Depth Heterogeneity in Neural Architectures, by Akash Guna R.t et al.
Beyond Uniform Scaling: Exploring Depth Heterogeneity in Neural Architecturesby Akash Guna R.T, Arnav Chavan, Deepak…
Summary of Induced Model Matching: How Restricted Models Can Help Larger Ones, by Usama Muneeb and Mesrob I. Ohannessian
Induced Model Matching: How Restricted Models Can Help Larger Onesby Usama Muneeb, Mesrob I. OhannessianFirst…
Summary of Locality-sensitive Hashing-based Efficient Point Transformer with Applications in High-energy Physics, by Siqi Miao et al.
Locality-Sensitive Hashing-Based Efficient Point Transformer with Applications in High-Energy Physicsby Siqi Miao, Zhiyuan Lu, Mia…