Summary of See: Sememe Entanglement Encoding For Transformer-bases Models Compression, by Jing Zhang et al.
SEE: Sememe Entanglement Encoding for Transformer-bases Models Compressionby Jing Zhang, Shuzhen Sun, Peng Zhang, Guangxing…
Summary of Edformer: Embedded Decomposition Transformer For Interpretable Multivariate Time Series Predictions, by Sanjay Chakraborty et al.
EDformer: Embedded Decomposition Transformer for Interpretable Multivariate Time Series Predictionsby Sanjay Chakraborty, Ibrahim Delibasoglu, Fredrik…
Summary of Climate Aware Deep Neural Networks (cadnn) For Wind Power Simulation, by Ali Forootani et al.
Climate Aware Deep Neural Networks (CADNN) for Wind Power Simulationby Ali Forootani, Danial Esmaeili Aliabadi,…
Summary of Citrus: Squeezing Extra Performance Out Of Low-data Bio-signal Transfer Learning, by Eloy Geenjaar and Lie Lu
CiTrus: Squeezing Extra Performance out of Low-data Bio-signal Transfer Learningby Eloy Geenjaar, Lie LuFirst submitted…
Summary of No More Adam: Learning Rate Scaling at Initialization Is All You Need, by Minghao Xu et al.
No More Adam: Learning Rate Scaling at Initialization is All You Needby Minghao Xu, Lichuan…
Summary of Transformers Use Causal World Models in Maze-solving Tasks, by Alex F. Spies et al.
Transformers Use Causal World Models in Maze-Solving Tasksby Alex F. Spies, William Edwards, Michael I.…
Summary of Notecontrast: Contrastive Language-diagnostic Pretraining For Medical Text, by Prajwal Kailas et al.
NoteContrast: Contrastive Language-Diagnostic Pretraining for Medical Textby Prajwal Kailas, Max Homilius, Rahul C. Deo, Calum…
Summary of Understanding Knowledge Hijack Mechanism in In-context Learning Through Associative Memory, by Shuo Wang et al.
Understanding Knowledge Hijack Mechanism in In-context Learning through Associative Memoryby Shuo Wang, Issei SatoFirst submitted…
Summary of Transformer-based Bearing Fault Detection Using Temporal Decomposition Attention Mechanism, by Marzieh Mirzaeibonehkhater et al.
Transformer-Based Bearing Fault Detection using Temporal Decomposition Attention Mechanismby Marzieh Mirzaeibonehkhater, Mohammad Ali Labbaf-Khaniki, Mohammad…
Summary of A Comparative Study on Dynamic Graph Embedding Based on Mamba and Transformers, by Ashish Parmanand Pandey et al.
A Comparative Study on Dynamic Graph Embedding based on Mamba and Transformersby Ashish Parmanand Pandey,…