Summary of Understanding Transformer Reasoning Capabilities Via Graph Algorithms, by Clayton Sanford et al.
Understanding Transformer Reasoning Capabilities via Graph Algorithmsby Clayton Sanford, Bahare Fatemi, Ethan Hall, Anton Tsitsulin,…
Summary of Modeling Long Sequences in Bladder Cancer Recurrence: a Comparative Evaluation Of Lstm,transformer,and Mamba, by Runquan Zhang et al.
Modeling Long Sequences in Bladder Cancer Recurrence: A Comparative Evaluation of LSTM,Transformer,and Mambaby Runquan Zhang,…
Summary of Finercut: Finer-grained Interpretable Layer Pruning For Large Language Models, by Yang Zhang et al.
FinerCut: Finer-grained Interpretable Layer Pruning for Large Language Modelsby Yang Zhang, Yawei Li, Xinpeng Wang,…
Summary of 2bp: 2-stage Backpropagation, by Christopher Rae et al.
2BP: 2-Stage Backpropagationby Christopher Rae, Joseph K. L. Lee, James RichingsFirst submitted to arxiv on:…
Summary of Harmodt: Harmony Multi-task Decision Transformer For Offline Reinforcement Learning, by Shengchao Hu et al.
HarmoDT: Harmony Multi-Task Decision Transformer for Offline Reinforcement Learningby Shengchao Hu, Ziqing Fan, Li Shen,…
Summary of Delving Into Differentially Private Transformer, by Youlong Ding et al.
Delving into Differentially Private Transformerby Youlong Ding, Xueyang Wu, Yining Meng, Yonggang Luo, Hao Wang,…
Summary of Knowledge Circuits in Pretrained Transformers, by Yunzhi Yao et al.
Knowledge Circuits in Pretrained Transformersby Yunzhi Yao, Ningyu Zhang, Zekun Xi, Mengru Wang, Ziwen Xu,…
Summary of Exploring Context Window Of Large Language Models Via Decomposed Positional Vectors, by Zican Dong et al.
Exploring Context Window of Large Language Models via Decomposed Positional Vectorsby Zican Dong, Junyi Li,…
Summary of Boosting Protein Language Models with Negative Sample Mining, by Yaoyao Xu et al.
Boosting Protein Language Models with Negative Sample Miningby Yaoyao Xu, Xinjian Zhao, Xiaozhuang Song, Benyou…
Summary of Mechanistic Interpretability Of Binary and Ternary Transformers, by Jason Li
Mechanistic Interpretability of Binary and Ternary Transformersby Jason LiFirst submitted to arxiv on: 27 May…