Summary of Hymba: a Hybrid-head Architecture For Small Language Models, by Xin Dong et al.
Hymba: A Hybrid-head Architecture for Small Language Modelsby Xin Dong, Yonggan Fu, Shizhe Diao, Wonmin…
Summary of Transformers with Sparse Attention For Granger Causality, by Riya Mahesh et al.
Transformers with Sparse Attention for Granger Causalityby Riya Mahesh, Rahul Vashisht, Chandrashekar LakshminarayananFirst submitted to…
Summary of Synehrgy: Synthesizing Mixed-type Structured Electronic Health Records Using Decoder-only Transformers, by Hojjat Karami et al.
SynEHRgy: Synthesizing Mixed-Type Structured Electronic Health Records using Decoder-Only Transformersby Hojjat Karami, David Atienza, Anisoara…
Summary of Uniflow: a Foundation Model For Unified Urban Spatio-temporal Flow Prediction, by Yuan Yuan et al.
UniFlow: A Foundation Model for Unified Urban Spatio-Temporal Flow Predictionby Yuan Yuan, Jingtao Ding, Chonghua…
Summary of Selective Attention: Enhancing Transformer Through Principled Context Control, by Xuechen Zhang et al.
Selective Attention: Enhancing Transformer through Principled Context Controlby Xuechen Zhang, Xiangyu Chang, Mingchen Li, Amit…
Summary of Ultra: Unveiling Latent Token Interpretability in Transformer Based Understanding, by Hesam Hosseini et al.
ULTra: Unveiling Latent Token Interpretability in Transformer Based Understandingby Hesam Hosseini, Ghazal Hosseini Mighan, Amirabbas…
Summary of Dlbacktrace: a Model Agnostic Explainability For Any Deep Learning Models, by Vinay Kumar Sankarapu et al.
DLBacktrace: A Model Agnostic Explainability for any Deep Learning Modelsby Vinay Kumar Sankarapu, Chintan Chitroda,…
Summary of Ultra-sparse Memory Network, by Zihao Huang et al.
Ultra-Sparse Memory Networkby Zihao Huang, Qiyang Min, Hongzhi Huang, Defa Zhu, Yutao Zeng, Ran Guo,…
Summary of Comparing Prior and Learned Time Representations in Transformer Models Of Timeseries, by Natalia Koliou et al.
Comparing Prior and Learned Time Representations in Transformer Models of Timeseriesby Natalia Koliou, Tatiana Boura,…
Summary of Transformer Neural Processes – Kernel Regression, by Daniel Jenson et al.
Transformer Neural Processes - Kernel Regressionby Daniel Jenson, Jhonathan Navott, Mengyan Zhang, Makkunda Sharma, Elizaveta…