Summary of Mixture Of Experts Meets Prompt-based Continual Learning, by Minh Le et al.
Mixture of Experts Meets Prompt-Based Continual Learningby Minh Le, An Nguyen, Huy Nguyen, Trang Nguyen,…
Summary of Attention As An Rnn, by Leo Feng et al.
Attention as an RNNby Leo Feng, Frederick Tung, Hossein Hajimirsadeghi, Mohamed Osama Ahmed, Yoshua Bengio,…
Summary of Mitigating Interference in the Knowledge Continuum Through Attention-guided Incremental Learning, by Prashant Bhat et al.
Mitigating Interference in the Knowledge Continuum through Attention-Guided Incremental Learningby Prashant Bhat, Bharath Renjith, Elahe…
Summary of Dct-based Decorrelated Attention For Vision Transformers, by Hongyi Pan et al.
DCT-Based Decorrelated Attention for Vision Transformersby Hongyi Pan, Emadeldeen Hamdan, Xin Zhu, Koushik Biswas, Ahmet…
Summary of A Transformer Variant For Multi-step Forecasting Of Water Level and Hydrometeorological Sensitivity Analysis Based on Explainable Artificial Intelligence Technology, by Mingyu Liu et al.
A Transformer variant for multi-step forecasting of water level and hydrometeorological sensitivity analysis based on…
Summary of Generalized Laplace Approximation, by Yinsong Chen et al.
Generalized Laplace Approximationby Yinsong Chen, Samson S. Yu, Zhong Li, Chee Peng LimFirst submitted to…
Summary of Faith: Frequency-domain Attention in Two Horizons For Time Series Forecasting, by Ruiqi Li et al.
FAITH: Frequency-domain Attention In Two Horizons for Time Series Forecastingby Ruiqi Li, Maowei Jiang, Kai…
Summary of Dynamic Context Adaptation and Information Flow Control in Transformers: Introducing the Evaluator Adjuster Unit and Gated Residual Connections, by Sahil Rajesh Dhayalkar
Dynamic Context Adaptation and Information Flow Control in Transformers: Introducing the Evaluator Adjuster Unit and…
Summary of Dataset Decomposition: Faster Llm Training with Variable Sequence Length Curriculum, by Hadi Pouransari et al.
Dataset Decomposition: Faster LLM Training with Variable Sequence Length Curriculumby Hadi Pouransari, Chun-Liang Li, Jen-Hao…
Summary of Reducing Transformer Key-value Cache Size with Cross-layer Attention, by William Brandon et al.
Reducing Transformer Key-Value Cache Size with Cross-Layer Attentionby William Brandon, Mayank Mishra, Aniruddha Nrusimha, Rameswar…