Summary of Merging Multi-task Models Via Weight-ensembling Mixture Of Experts, by Anke Tang et al.
Merging Multi-Task Models via Weight-Ensembling Mixture of Expertsby Anke Tang, Li Shen, Yong Luo, Nan…
Summary of Understanding the Expressive Power and Mechanisms Of Transformer For Sequence Modeling, by Mingze Wang et al.
Understanding the Expressive Power and Mechanisms of Transformer for Sequence Modelingby Mingze Wang, Weinan EFirst…
Summary of Positional Encoding Helps Recurrent Neural Networks Handle a Large Vocabulary, by Takashi Morita
Positional Encoding Helps Recurrent Neural Networks Handle a Large Vocabularyby Takashi MoritaFirst submitted to arxiv…
Summary of Efficient Subseasonal Weather Forecast Using Teleconnection-informed Transformers, by Shan Zhao et al.
Efficient Subseasonal Weather Forecast using Teleconnection-informed Transformersby Shan Zhao, Zhitong Xiong, Xiao Xiang ZhuFirst submitted…
Summary of Graph Transformers Without Positional Encodings, by Ayush Garg
Graph Transformers without Positional Encodingsby Ayush GargFirst submitted to arxiv on: 31 Jan 2024CategoriesMain: Machine…
Summary of Swea: Updating Factual Knowledge in Large Language Models Via Subject Word Embedding Altering, by Xiaopeng Li et al.
SWEA: Updating Factual Knowledge in Large Language Models via Subject Word Embedding Alteringby Xiaopeng Li,…
Summary of Scavenging Hyena: Distilling Transformers Into Long Convolution Models, by Tokiniaina Raharison Ralambomihanta et al.
Scavenging Hyena: Distilling Transformers into Long Convolution Modelsby Tokiniaina Raharison Ralambomihanta, Shahrad Mohammadzadeh, Mohammad Sami…
Summary of Retrieval Augmented Deep Anomaly Detection For Tabular Data, by Hugo Thimonier et al.
Retrieval Augmented Deep Anomaly Detection for Tabular Databy Hugo Thimonier, Fabrice Popineau, Arpad Rimmel, Bich-Liên…
Summary of Engineering a Large Language Model From Scratch, by Abiodun Finbarrs Oketunji
Engineering A Large Language Model From Scratchby Abiodun Finbarrs OketunjiFirst submitted to arxiv on: 30…
Summary of Validation, Robustness, and Accuracy Of Perturbation-based Sensitivity Analysis Methods For Time-series Deep Learning Models, by Zhengguang Wang
Validation, Robustness, and Accuracy of Perturbation-Based Sensitivity Analysis Methods for Time-Series Deep Learning Modelsby Zhengguang…