Summary of Sageattention: Accurate 8-bit Attention For Plug-and-play Inference Acceleration, by Jintao Zhang et al.
SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationby Jintao Zhang, Jia wei, Haofeng Huang, Pengle…
Summary of Unveiling Ai’s Blind Spots: An Oracle For In-domain, Out-of-domain, and Adversarial Errors, by Shuangpeng Han et al.
Unveiling AI’s Blind Spots: An Oracle for In-Domain, Out-of-Domain, and Adversarial Errorsby Shuangpeng Han, Mengmi…
Summary of Menakbert — Hebrew Diacriticizer, by Ido Cohen et al.
MenakBERT – Hebrew Diacriticizerby Ido Cohen, Jacob Gidron, Idan PintoFirst submitted to arxiv on: 3…
Summary of Hatformer: Historic Handwritten Arabic Text Recognition with Transformers, by Adrian Chan et al.
HATFormer: Historic Handwritten Arabic Text Recognition with Transformersby Adrian Chan, Anupam Mijar, Mehreen Saeed, Chau-Wai…
Summary of Ec-dit: Scaling Diffusion Transformers with Adaptive Expert-choice Routing, by Haotian Sun et al.
EC-DIT: Scaling Diffusion Transformers with Adaptive Expert-Choice Routingby Haotian Sun, Tao Lei, Bowen Zhang, Yanghao…
Summary of Trajgpt: Irregular Time-series Representation Learning For Health Trajectory Analysis, by Ziyang Song et al.
TrajGPT: Irregular Time-Series Representation Learning for Health Trajectory Analysisby Ziyang Song, Qingcheng Lu, He Zhu,…
Summary of A Formal Framework For Understanding Length Generalization in Transformers, by Xinting Huang et al.
A Formal Framework for Understanding Length Generalization in Transformersby Xinting Huang, Andy Yang, Satwik Bhattamishra,…
Summary of Deepprotein: Deep Learning Library and Benchmark For Protein Sequence Learning, by Jiaqing Xie et al.
DeepProtein: Deep Learning Library and Benchmark for Protein Sequence Learningby Jiaqing Xie, Yue Zhao, Tianfan…
Summary of Positional Attention: Expressivity and Learnability Of Algorithmic Computation, by Artur Back De Luca et al.
Positional Attention: Expressivity and Learnability of Algorithmic Computationby Artur Back de Luca, George Giapitzakis, Shenghao…
Summary of Trained Transformer Classifiers Generalize and Exhibit Benign Overfitting In-context, by Spencer Frei and Gal Vardi
Trained Transformer Classifiers Generalize and Exhibit Benign Overfitting In-Contextby Spencer Frei, Gal VardiFirst submitted to…