Summary of Cross-architecture Transfer Learning For Linear-cost Inference Transformers, by Sehyun Choi
Cross-Architecture Transfer Learning for Linear-Cost Inference Transformersby Sehyun ChoiFirst submitted to arxiv on: 3 Apr…
Summary of Mixture-of-depths: Dynamically Allocating Compute in Transformer-based Language Models, by David Raposo et al.
Mixture-of-Depths: Dynamically allocating compute in transformer-based language modelsby David Raposo, Sam Ritter, Blake Richards, Timothy…
Summary of Egtr: Extracting Graph From Transformer For Scene Graph Generation, by Jinbae Im et al.
EGTR: Extracting Graph from Transformer for Scene Graph Generationby Jinbae Im, JeongYeon Nam, Nokyung Park,…
Summary of Decision Mamba: Reinforcement Learning Via Sequence Modeling with Selective State Spaces, by Toshihiro Ota
Decision Mamba: Reinforcement Learning via Sequence Modeling with Selective State Spacesby Toshihiro OtaFirst submitted to…
Summary of Fourier or Wavelet Bases As Counterpart Self-attention in Spikformer For Efficient Visual Classification, by Qingyu Wang et al.
Fourier or Wavelet bases as counterpart self-attention in spikformer for efficient visual classificationby Qingyu Wang,…
Summary of Self-rectifying Diffusion Sampling with Perturbed-attention Guidance, by Donghoon Ahn et al.
Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidanceby Donghoon Ahn, Hyoungwon Cho, Jaewon Min, Wooseok Jang, Jungwoo…
Summary of Gtc: Gnn-transformer Co-contrastive Learning For Self-supervised Heterogeneous Graph Representation, by Yundong Sun et al.
GTC: GNN-Transformer Co-contrastive Learning for Self-supervised Heterogeneous Graph Representationby Yundong Sun, Dongjie Zhu, Yansong Wang,…
Summary of A Task Of Anomaly Detection For a Smart Satellite Internet Of Things System, by Zilong Shao
A task of anomaly detection for a smart satellite Internet of things systemby Zilong ShaoFirst…
Summary of Divide-conquer Transformer Learning For Predicting Electric Vehicle Charging Events Using Smart Meter Data, by Fucai Ke et al.
Divide-Conquer Transformer Learning for Predicting Electric Vehicle Charging Events Using Smart Meter Databy Fucai Ke,…
Summary of Pretraining Codomain Attention Neural Operators For Solving Multiphysics Pdes, by Md Ashiqur Rahman et al.
Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEsby Md Ashiqur Rahman, Robert Joseph George,…