Summary of Decomposable Transformer Point Processes, by Aristeidis Panos
Decomposable Transformer Point Processesby Aristeidis PanosFirst submitted to arxiv on: 26 Sep 2024CategoriesMain: Machine Learning…
Summary of A Multi-source Data Power Load Forecasting Method Using Attention Mechanism-based Parallel Cnn-gru, by Chao Min et al.
A multi-source data power load forecasting method using attention mechanism-based parallel cnn-gruby Chao Min, Yijia…
Summary of Hydravit: Stacking Heads For a Scalable Vit, by Janek Haberer et al.
HydraViT: Stacking Heads for a Scalable ViTby Janek Haberer, Ali Hojjat, Olaf LandsiedelFirst submitted to…
Summary of Benign Overfitting in Token Selection Of Attention Mechanism, by Keitaro Sakamoto and Issei Sato
Benign Overfitting in Token Selection of Attention Mechanismby Keitaro Sakamoto, Issei SatoFirst submitted to arxiv…
Summary of Caspformer: Trajectory Prediction From Bev Images with Deformable Attention, by Harsh Yadav et al.
CASPFormer: Trajectory Prediction from BEV Images with Deformable Attentionby Harsh Yadav, Maximilian Schaefer, Kun Zhao,…
Summary of Discovering the Gems in Early Layers: Accelerating Long-context Llms with 1000x Input Token Reduction, by Zhenmei Shi et al.
Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reductionby Zhenmei…
Summary of Non-asymptotic Convergence Of Training Transformers For Next-token Prediction, by Ruiquan Huang et al.
Non-asymptotic Convergence of Training Transformers for Next-token Predictionby Ruiquan Huang, Yingbin Liang, Jing YangFirst submitted…
Summary of Int-flashattention: Enabling Flash Attention For Int8 Quantization, by Shimao Chen et al.
INT-FlashAttention: Enabling Flash Attention for INT8 Quantizationby Shimao Chen, Zirui Liu, Zhiying Wu, Ce Zheng,…
Summary of Supervised Fine-tuning Achieve Rapid Task Adaption Via Alternating Attention Head Activation Patterns, by Yang Zhao et al.
Supervised Fine-Tuning Achieve Rapid Task Adaption Via Alternating Attention Head Activation Patternsby Yang Zhao, Li…
Summary of Trajectory Anomaly Detection with Language Models, by Jonathan Mbuya et al.
Trajectory Anomaly Detection with Language Modelsby Jonathan Mbuya, Dieter Pfoser, Antonios AnastasopoulosFirst submitted to arxiv…