Summary of Selective Attention Improves Transformer, by Yaniv Leviathan et al.
Selective Attention Improves Transformerby Yaniv Leviathan, Matan Kalman, Yossi MatiasFirst submitted to arxiv on: 3…
Summary of Immunogenicity Prediction with Dual Attention Enables Vaccine Target Selection, by Song Li et al.
Immunogenicity Prediction with Dual Attention Enables Vaccine Target Selectionby Song Li, Yang Tan, Song Ke,…
Summary of Deconstructing Recurrence, Attention, and Gating: Investigating the Transferability Of Transformers and Gated Recurrent Neural Networks in Forecasting Of Dynamical Systems, by Hunter S. Heidenreich et al.
Deconstructing Recurrence, Attention, and Gating: Investigating the transferability of Transformers and Gated Recurrent Neural Networks…
Summary of Beyond Squared Error: Exploring Loss Design For Enhanced Training Of Generative Flow Networks, by Rui Hu et al.
Beyond Squared Error: Exploring Loss Design for Enhanced Training of Generative Flow Networksby Rui Hu,…
Summary of Listening to the Wise Few: Select-and-copy Attention Heads For Multiple-choice Qa, by Eduard Tulchinskii et al.
Listening to the Wise Few: Select-and-Copy Attention Heads for Multiple-Choice QAby Eduard Tulchinskii, Laida Kushnareva,…
Summary of Sageattention: Accurate 8-bit Attention For Plug-and-play Inference Acceleration, by Jintao Zhang et al.
SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationby Jintao Zhang, Jia wei, Haofeng Huang, Pengle…
Summary of Training Nonlinear Transformers For Chain-of-thought Inference: a Theoretical Generalization Analysis, by Hongkang Li et al.
Training Nonlinear Transformers for Chain-of-Thought Inference: A Theoretical Generalization Analysisby Hongkang Li, Meng Wang, Songtao…
Summary of Hatformer: Historic Handwritten Arabic Text Recognition with Transformers, by Adrian Chan et al.
HATFormer: Historic Handwritten Arabic Text Recognition with Transformersby Adrian Chan, Anupam Mijar, Mehreen Saeed, Chau-Wai…
Summary of Hyperbrain: Anomaly Detection For Temporal Hypergraph Brain Networks, by Sadaf Sadeghian et al.
HyperBrain: Anomaly Detection for Temporal Hypergraph Brain Networksby Sadaf Sadeghian, Xiaoxiao Li, Margo SeltzerFirst submitted…
Summary of Searching For Efficient Linear Layers Over a Continuous Space Of Structured Matrices, by Andres Potapczynski et al.
Searching for Efficient Linear Layers over a Continuous Space of Structured Matricesby Andres Potapczynski, Shikai…