Summary of Beyond Linear Approximations: a Novel Pruning Approach For Attention Matrix, by Yingyu Liang et al.
Beyond Linear Approximations: A Novel Pruning Approach for Attention Matrixby Yingyu Liang, Jiangxuan Long, Zhenmei…
Summary of Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent, By Bo Chen et al.
Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descentby Bo Chen,…
Summary of Umambatsf: a U-shaped Multi-scale Long-term Time Series Forecasting Method Using Mamba, by Li Wu et al.
UmambaTSF: A U-shaped Multi-Scale Long-Term Time Series Forecasting Method Using Mambaby Li Wu, Wenbin Pei,…
Summary of Tram : Enhancing User Sleep Prediction with Transformer-based Multivariate Time Series Modeling and Machine Learning Ensembles, by Jinjae Kim et al.
TraM : Enhancing User Sleep Prediction with Transformer-based Multivariate Time Series Modeling and Machine Learning…
Summary of Rethinking Graph Transformer Architecture Design For Node Classification, by Jiajun Zhou et al.
Rethinking Graph Transformer Architecture Design for Node Classificationby Jiajun Zhou, Xuanze Chen, Chenxuan Xie, Yu…
Summary of Towards Better Multi-head Attention Via Channel-wise Sample Permutation, by Shen Yuan et al.
Towards Better Multi-head Attention via Channel-wise Sample Permutationby Shen Yuan, Hongteng XuFirst submitted to arxiv…
Summary of What Does It Mean to Be a Transformer? Insights From a Theoretical Hessian Analysis, by Weronika Ormaniec et al.
What Does It Mean to Be a Transformer? Insights from a Theoretical Hessian Analysisby Weronika…
Summary of Hart: Efficient Visual Generation with Hybrid Autoregressive Transformer, by Haotian Tang et al.
HART: Efficient Visual Generation with Hybrid Autoregressive Transformerby Haotian Tang, Yecheng Wu, Shang Yang, Enze…
Summary of Transforming Game Play: a Comparative Study Of Dcqn and Dtqn Architectures in Reinforcement Learning, by William A. Stigall
Transforming Game Play: A Comparative Study of DCQN and DTQN Architectures in Reinforcement Learningby William…
Summary of Transparent Networks For Multivariate Time Series, by Minkyu Kim et al.
Transparent Networks for Multivariate Time Seriesby Minkyu Kim, Suan Lee, Jinho KimFirst submitted to arxiv…