Summary of The Fine-grained Complexity Of Gradient Computation For Training Large Language Models, by Josh Alman et al.
The Fine-Grained Complexity of Gradient Computation for Training Large Language Modelsby Josh Alman, Zhao SongFirst…
Summary of The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry, by Michael Zhang et al.
The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicryby Michael Zhang, Kush Bhatia,…
Summary of Attention with Markov: a Framework For Principled Analysis Of Transformers Via Markov Chains, by Ashok Vardhan Makkuva et al.
Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chainsby Ashok Vardhan…
Summary of Cast: Clustering Self-attention Using Surrogate Tokens For Efficient Transformers, by Adjorn Van Engelenhoven et al.
CAST: Clustering Self-Attention using Surrogate Tokens for Efficient Transformersby Adjorn van Engelenhoven, Nicola Strisciuglio, EstefanÃa…
Summary of Can Mamba Learn How to Learn? a Comparative Study on In-context Learning Tasks, by Jongho Park et al.
Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasksby Jongho Park,…
Summary of Provably Learning a Multi-head Attention Layer, by Sitan Chen et al.
Provably learning a multi-head attention layerby Sitan Chen, Yuanzhi LiFirst submitted to arxiv on: 6…
Summary of A Phase Transition Between Positional and Semantic Learning in a Solvable Model Of Dot-product Attention, by Hugo Cui et al.
A phase transition between positional and semantic learning in a solvable model of dot-product attentionby…
Summary of Return-aligned Decision Transformer, by Tsunehiko Tanaka et al.
Return-Aligned Decision Transformerby Tsunehiko Tanaka, Kenshi Abe, Kaito Ariu, Tetsuro Morimura, Edgar Simo-SerraFirst submitted to…
Summary of Reinforcement Learning From Bagged Reward, by Yuting Tang and Xin-qiang Cai and Yao-xiang Ding and Qiyu Wu and Guoqing Liu and Masashi Sugiyama
Reinforcement Learning from Bagged Rewardby Yuting Tang, Xin-Qiang Cai, Yao-Xiang Ding, Qiyu Wu, Guoqing Liu,…
Summary of Face Detection: Present State and Research Directions, by Purnendu Prabhat et al.
Face Detection: Present State and Research Directionsby Purnendu Prabhat, Himanshu Gupta, Ajeet Kumar VishwakarmaFirst submitted…