Summary of Loki: Low-rank Keys For Efficient Sparse Attention, by Prajwal Singhania et al.
Loki: Low-rank Keys for Efficient Sparse Attentionby Prajwal Singhania, Siddharth Singh, Shwai He, Soheil Feizi,…
Summary of Learning to Grok: Emergence Of In-context Learning and Skill Composition in Modular Arithmetic Tasks, by Tianyu He et al.
Learning to grok: Emergence of in-context learning and skill composition in modular arithmetic tasksby Tianyu…
Summary of Progressive Confident Masking Attention Network For Audio-visual Segmentation, by Yuxuan Wang et al.
Progressive Confident Masking Attention Network for Audio-Visual Segmentationby Yuxuan Wang, Jinchao Zhu, Feng Dong, Shuyue…
Summary of What Improves the Generalization Of Graph Transformers? a Theoretical Dive Into the Self-attention and Positional Encoding, by Hongkang Li et al.
What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional…
Summary of Ffnet: Metamixer-based Efficient Convolutional Mixer Design, by Seokju Yun et al.
FFNet: MetaMixer-based Efficient Convolutional Mixer Designby Seokju Yun, Dongheon Lee, Youngmin RoFirst submitted to arxiv…
Summary of Iteration Head: a Mechanistic Study Of Chain-of-thought, by Vivien Cabannes et al.
Iteration Head: A Mechanistic Study of Chain-of-Thoughtby Vivien Cabannes, Charles Arnal, Wassim Bouaziz, Alice Yang,…
Summary of Cafo: Feature-centric Explanation on Time Series Classification, by Jaeho Kim et al.
CAFO: Feature-Centric Explanation on Time Series Classificationby Jaeho Kim, Seok-Ju Hahn, Yoontae Hwang, Junghye Lee,…
Summary of A Global Geometric Analysis Of Maximal Coding Rate Reduction, by Peng Wang et al.
A Global Geometric Analysis of Maximal Coding Rate Reductionby Peng Wang, Huikang Liu, Druv Pai,…
Summary of Position: Cracking the Code Of Cascading Disparity Towards Marginalized Communities, by Golnoosh Farnadi et al.
Position: Cracking the Code of Cascading Disparity Towards Marginalized Communitiesby Golnoosh Farnadi, Mohammad Havaei, Negar…
Summary of Diffuhaul: a Training-free Method For Object Dragging in Images, by Omri Avrahami et al.
DiffUHaul: A Training-Free Method for Object Dragging in Imagesby Omri Avrahami, Rinon Gal, Gal Chechik,…