Summary of State Space Model For New-generation Network Alternative to Transformers: a Survey, by Xiao Wang et al.
State Space Model for New-Generation Network Alternative to Transformers: A Surveyby Xiao Wang, Shiao Wang,…
Summary of Bert-lsh: Reducing Absolute Compute For Attention, by Zezheng Li et al.
BERT-LSH: Reducing Absolute Compute For Attentionby Zezheng Li, Kingston YipFirst submitted to arxiv on: 12…
Summary of Inheritune: Training Smaller Yet More Attentive Language Models, by Sunny Sanyal et al.
Inheritune: Training Smaller Yet More Attentive Language Modelsby Sunny Sanyal, Ravid Shwartz-Ziv, Alexandros G. Dimakis,…
Summary of Lloco: Learning Long Contexts Offline, by Sijun Tan et al.
LLoCO: Learning Long Contexts Offlineby Sijun Tan, Xiuyu Li, Shishir Patil, Ziyang Wu, Tianjun Zhang,…
Summary of Localizing Moments Of Actions in Untrimmed Videos Of Infants with Autism Spectrum Disorder, by Halil Ismail Helvaci et al.
Localizing Moments of Actions in Untrimmed Videos of Infants with Autism Spectrum Disorderby Halil Ismail…
Summary of Squeezeattention: 2d Management Of Kv-cache in Llm Inference Via Layer-wise Optimal Budget, by Zihao Wang et al.
SqueezeAttention: 2D Management of KV-Cache in LLM Inference via Layer-wise Optimal Budgetby Zihao Wang, Bin…
Summary of Enhancing Iot Intelligence: a Transformer-based Reinforcement Learning Methodology, by Gaith Rjoub et al.
Enhancing IoT Intelligence: A Transformer-based Reinforcement Learning Methodologyby Gaith Rjoub, Saidul Islam, Jamal Bentahar, Mohammed…
Summary of Graph Neural Networks For Electric and Hydraulic Data Fusion to Enhance Short-term Forecasting Of Pumped-storage Hydroelectricity, by Raffael Theiler et al.
Graph Neural Networks for Electric and Hydraulic Data Fusion to Enhance Short-term Forecasting of Pumped-storage…
Summary of On the Theoretical Expressive Power and the Design Space Of Higher-order Graph Transformers, by Cai Zhou et al.
On the Theoretical Expressive Power and the Design Space of Higher-Order Graph Transformersby Cai Zhou,…
Summary of Optimizing the Deployment Of Tiny Transformers on Low-power Mcus, by Victor J.b. Jung et al.
Optimizing the Deployment of Tiny Transformers on Low-Power MCUsby Victor J.B. Jung, Alessio Burrello, Moritz…