Summary of Mind the Gap: a Spectral Analysis Of Rank Collapse and Signal Propagation in Attention Layers, by Alireza Naderi et al.
Mind the Gap: a Spectral Analysis of Rank Collapse and Signal Propagation in Attention Layersby…
Summary of Masked Generative Priors Improve World Models Sequence Modelling Capabilities, by Cristian Meo and Mircea Lica and Zarif Ikram and Akihiro Nakano and Vedant Shah and Aniket Rajiv Didolkar and Dianbo Liu and Anirudh Goyal and Justin Dauwels
Masked Generative Priors Improve World Models Sequence Modelling Capabilitiesby Cristian Meo, Mircea Lica, Zarif Ikram,…
Summary of Offline Inverse Constrained Reinforcement Learning For Safe-critical Decision Making in Healthcare, by Nan Fang et al.
Offline Inverse Constrained Reinforcement Learning for Safe-Critical Decision Making in Healthcareby Nan Fang, Guiliang Liu,…
Summary of Toward Robust Real-world Audio Deepfake Detection: Closing the Explainability Gap, by Georgia Channing et al.
Toward Robust Real-World Audio Deepfake Detection: Closing the Explainability Gapby Georgia Channing, Juil Sock, Ronald…
Summary of Exploring the Design Space Of Deep-learning-based Weather Forecasting Systems, by Shoaib Ahmed Siddiqui et al.
Exploring the design space of deep-learning-based weather forecasting systemsby Shoaib Ahmed Siddiqui, Jean Kossaifi, Boris…
Summary of Inattention: Linear Context Scaling For Transformers, by Joseph Eisner
InAttention: Linear Context Scaling for Transformersby Joseph EisnerFirst submitted to arxiv on: 9 Oct 2024CategoriesMain:…
Summary of Retrieval-augmented Decision Transformer: External Memory For In-context Rl, by Thomas Schmied et al.
Retrieval-Augmented Decision Transformer: External Memory for In-context RLby Thomas Schmied, Fabian Paischer, Vihang Patil, Markus…
Summary of Gridded Transformer Neural Processes For Large Unstructured Spatio-temporal Data, by Matthew Ashman et al.
Gridded Transformer Neural Processes for Large Unstructured Spatio-Temporal Databy Matthew Ashman, Cristiana Diaconu, Eric Langezaal,…
Summary of Cluster-wise Graph Transformer with Dual-granularity Kernelized Attention, by Siyuan Huang et al.
Cluster-wise Graph Transformer with Dual-granularity Kernelized Attentionby Siyuan Huang, Yunchong Song, Jiayue Zhou, Zhouhan LinFirst…
Summary of Joint Fine-tuning and Conversion Of Pretrained Speech and Language Models Towards Linear Complexity, by Mutian He et al.
Joint Fine-tuning and Conversion of Pretrained Speech and Language Models towards Linear Complexityby Mutian He,…