Summary of Accelerating Transformer Pre-training with 2:4 Sparsity, by Yuezhou Hu et al.
Accelerating Transformer Pre-training with 2:4 Sparsityby Yuezhou Hu, Kang Zhao, Weiyu Huang, Jianfei Chen, Jun…
Summary of What Can Transformer Learn with Varying Depth? Case Studies on Sequence Learning Tasks, by Xingwu Chen et al.
What Can Transformer Learn with Varying Depth? Case Studies on Sequence Learning Tasksby Xingwu Chen,…
Summary of Audio Simulation For Sound Source Localization in Virtual Evironment, by Yi Di Yuan et al.
Audio Simulation for Sound Source Localization in Virtual Evironmentby Yi Di Yuan, Swee Liang Wong,…
Summary of Transformer Meets Wcdtw to Improve Real-time Battery Bids: a New Approach to Scenario Selection, by Sujal Bhavsar et al.
Transformer meets wcDTW to improve real-time battery bids: A new approach to scenario selectionby Sujal…
Summary of Contrastcad: Contrastive Learning-based Representation Learning For Computer-aided Design Models, by Minseop Jung et al.
ContrastCAD: Contrastive Learning-based Representation Learning for Computer-Aided Design Modelsby Minseop Jung, Minseong Kim, Jibum KimFirst…
Summary of Prompt-prompted Adaptive Structured Pruning For Efficient Llm Generation, by Harry Dong et al.
Prompt-prompted Adaptive Structured Pruning for Efficient LLM Generationby Harry Dong, Beidi Chen, Yuejie ChiFirst submitted…
Summary of Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in Transformers, by Philip Kenneweg et al.
Intelligent Learning Rate Distribution to reduce Catastrophic Forgetting in Transformersby Philip Kenneweg, Alexander Schulz, Sarah…
Summary of Prompt Learning For Oriented Power Transmission Tower Detection in High-resolution Sar Images, by Tianyang Li et al.
Prompt Learning for Oriented Power Transmission Tower Detection in High-Resolution SAR Imagesby Tianyang Li, Chao…
Summary of On Difficulties Of Attention Factorization Through Shared Memory, by Uladzislau Yorsh et al.
On Difficulties of Attention Factorization through Shared Memoryby Uladzislau Yorsh, Martin Holeňa, Ondřej Bojar, David…
Summary of A General and Efficient Training For Transformer Via Token Expansion, by Wenxuan Huang et al.
A General and Efficient Training for Transformer via Token Expansionby Wenxuan Huang, Yunhang Shen, Jiao…