Summary of Adaptive Large Language Models by Layerwise Attention Shortcuts, By Prateek Verma et al.
Adaptive Large Language Models By Layerwise Attention Shortcutsby Prateek Verma, Mert PilanciFirst submitted to arxiv…
Summary of Contrasformer: a Brain Network Contrastive Transformer For Neurodegenerative Condition Identification, by Jiaxing Xu et al.
Contrasformer: A Brain Network Contrastive Transformer for Neurodegenerative Condition Identificationby Jiaxing Xu, Kai He, Mengcheng…
Summary of Cross-lingual Transfer Of Multilingual Models on Low Resource African Languages, by Harish Thangaraj et al.
Cross-lingual transfer of multilingual models on low resource African Languagesby Harish Thangaraj, Ananya Chenat, Jaskaran…
Summary of Kolmogorov-arnold Transformer, by Xingyi Yang et al.
Kolmogorov-Arnold Transformerby Xingyi Yang, Xinchao WangFirst submitted to arxiv on: 16 Sep 2024CategoriesMain: Machine Learning…
Summary of Exploring Fine-tuned Generative Models For Keyphrase Selection: a Case Study For Russian, by Anna Glazkova and Dmitry Morozov
Exploring Fine-tuned Generative Models for Keyphrase Selection: A Case Study for Russianby Anna Glazkova, Dmitry…
Summary of Mitigating Partial Observability in Adaptive Traffic Signal Control with Transformers, by Xiaoyu Wang et al.
Mitigating Partial Observability in Adaptive Traffic Signal Control with Transformersby Xiaoyu Wang, Ayal Taitler, Scott…
Summary of Flash Stu: Fast Spectral Transform Units, by Y. Isabel Liu and Windsor Nguyen and Yagiz Devre and Evan Dogariu and Anirudha Majumdar and Elad Hazan
Flash STU: Fast Spectral Transform Unitsby Y. Isabel Liu, Windsor Nguyen, Yagiz Devre, Evan Dogariu,…
Summary of Causal Language Modeling Can Elicit Search and Reasoning Capabilities on Logic Puzzles, by Kulin Shah et al.
Causal Language Modeling Can Elicit Search and Reasoning Capabilities on Logic Puzzlesby Kulin Shah, Nishanth…
Summary of Retrievalattention: Accelerating Long-context Llm Inference Via Vector Retrieval, by Di Liu et al.
RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrievalby Di Liu, Meng Chen, Baotong Lu, Huiqiang…
Summary of Unveiling Induction Heads: Provable Training Dynamics and Feature Learning in Transformers, by Siyu Chen et al.
Unveiling Induction Heads: Provable Training Dynamics and Feature Learning in Transformersby Siyu Chen, Heejune Sheen,…