Summary of Enhanced Structured State Space Models Via Grouped Fir Filtering and Attention Sink Mechanisms, by Tian Meng et al.
Enhanced Structured State Space Models via Grouped FIR Filtering and Attention Sink Mechanismsby Tian Meng,…
Summary of Mart: Multiscale Relational Transformer Networks For Multi-agent Trajectory Prediction, by Seongju Lee et al.
MART: MultiscAle Relational Transformer Networks for Multi-agent Trajectory Predictionby Seongju Lee, Junseok Lee, Yeonguk Yu,…
Summary of An Explainable Vision Transformer with Transfer Learning Combined with Support Vector Machine Based Efficient Drought Stress Identification, by Aswini Kumar Patra et al.
An Explainable Vision Transformer with Transfer Learning Combined with Support Vector Machine Based Efficient Drought…
Summary of Contrastive Factor Analysis, by Zhibin Duan et al.
Contrastive Factor Analysisby Zhibin Duan, Tiansheng Wen, Yifei Wang, Chen Zhu, Bo Chen, Mingyuan ZhouFirst…
Summary of Evaluating Long Range Dependency Handling in Code Generation Models Using Multi-step Key Retrieval, by Yannick Assogba et al.
Evaluating Long Range Dependency Handling in Code Generation Models using Multi-Step Key Retrievalby Yannick Assogba,…
Summary of Palu: Compressing Kv-cache with Low-rank Projection, by Chi-chih Chang et al.
Palu: Compressing KV-Cache with Low-Rank Projectionby Chi-Chih Chang, Wei-Cheng Lin, Chien-Yu Lin, Chong-Yan Chen, Yu-Fang…
Summary of Interpretable Pre-trained Transformers For Heart Time-series Data, by Harry J. Davies et al.
Interpretable Pre-Trained Transformers for Heart Time-Series Databy Harry J. Davies, James Monsen, Danilo P. MandicFirst…
Summary of A2sf: Accumulative Attention Scoring with Forgetting Factor For Token Pruning in Transformer Decoder, by Hyun-rae Jo et al.
A2SF: Accumulative Attention Scoring with Forgetting Factor for Token Pruning in Transformer Decoderby Hyun-rae Jo,…
Summary of Mimiq: Low-bit Data-free Quantization Of Vision Transformers with Encouraging Inter-head Attention Similarity, by Kanghyun Choi et al.
MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarityby Kanghyun Choi, Hye…
Summary of Multiscale Representation Enhanced Temporal Flow Fusion Model For Long-term Workload Forecasting, by Shiyu Wang et al.
Multiscale Representation Enhanced Temporal Flow Fusion Model for Long-Term Workload Forecastingby Shiyu Wang, Zhixuan Chu,…