Summary of Hierarchical Transformer For Electrocardiogram Diagnosis, by Xiaoya Tang et al.
Hierarchical Transformer for Electrocardiogram Diagnosisby Xiaoya Tang, Jake Berquist, Benjamin A. Steinberg, Tolga TasdizenFirst submitted…
Summary of Adapting Language Models Via Token Translation, by Zhili Feng et al.
Adapting Language Models via Token Translationby Zhili Feng, Tanya Marwah, Nicolo Fusi, David Alvarez-Melis, Lester…
Summary of Hierarchical Preference Optimization: Learning to Achieve Goals Via Feasible Subgoals Prediction, by Utsav Singh et al.
Hierarchical Preference Optimization: Learning to achieve goals via feasible subgoals predictionby Utsav Singh, Souradip Chakraborty,…
Summary of Interpretable Language Modeling Via Induction-head Ngram Models, by Eunji Kim et al.
Interpretable Language Modeling via Induction-head Ngram Modelsby Eunji Kim, Sriya Mantena, Weiwei Yang, Chandan Singh,…
Summary of The Belief State Transformer, by Edward S. Hu et al.
The Belief State Transformerby Edward S. Hu, Kwangjun Ahn, Qinghua Liu, Haoran Xu, Manan Tomar,…
Summary of Tiny Transformers Excel at Sentence Compression, by Peter Belcak et al.
Tiny Transformers Excel at Sentence Compressionby Peter Belcak, Roger WattenhoferFirst submitted to arxiv on: 30…
Summary of Learning and Transferring Sparse Contextual Bigrams with Linear Transformers, by Yunwei Ren et al.
Learning and Transferring Sparse Contextual Bigrams with Linear Transformersby Yunwei Ren, Zixuan Wang, Jason D.…
Summary of Emergence Of Meta-stable Clustering in Mean-field Transformer Models, by Giuseppe Bruno et al.
Emergence of meta-stable clustering in mean-field transformer modelsby Giuseppe Bruno, Federico Pasqualotto, Andrea AgazziFirst submitted…
Summary of Tokenformer: Rethinking Transformer Scaling with Tokenized Model Parameters, by Haiyang Wang et al.
TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parametersby Haiyang Wang, Yue Fan, Muhammad Ferjad Naeem,…
Summary of Accelerating Augmentation Invariance Pretraining, by Jinhong Lin et al.
Accelerating Augmentation Invariance Pretrainingby Jinhong Lin, Cheng-En Wu, Yibing Wei, Pedro MorgadoFirst submitted to arxiv…