Summary of Investigating Neuron Ablation in Attention Heads: the Case For Peak Activation Centering, by Nicholas Pochinkov et al.
Investigating Neuron Ablation in Attention Heads: The Case for Peak Activation Centeringby Nicholas Pochinkov, Ben…
Summary of The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by Leveraging Second-order Information, By Diyuan Wu et al.
The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by Leveraging Second-Order Informationby Diyuan Wu, Ionut-Vlad…
Summary of Modularity in Transformers: Investigating Neuron Separability & Specialization, by Nicholas Pochinkov et al.
Modularity in Transformers: Investigating Neuron Separability & Specializationby Nicholas Pochinkov, Thomas Jones, Mohammed Rashidur RahmanFirst…
Summary of An Empirical Study Of Scaling Laws For Transfer, by Matthew Barnett
An Empirical Study of Scaling Laws for Transferby Matthew BarnettFirst submitted to arxiv on: 30…
Summary of Error-controlled Non-additive Interaction Discovery in Machine Learning Models, by Winston Chen et al.
Error-controlled non-additive interaction discovery in machine learning modelsby Winston Chen, Yifan Jiang, William Stafford Noble,…
Summary of Hlogformer: a Hierarchical Transformer For Representing Log Data, by Zhichao Hou et al.
HLogformer: A Hierarchical Transformer for Representing Log Databy Zhichao Hou, Mina Ghashami, Mikhail Kuznetsov, MohamadAli…
Summary of On-device Ai: Quantization-aware Training Of Transformers in Time-series, by Tianheng Ling et al.
On-device AI: Quantization-aware Training of Transformers in Time-Seriesby Tianheng Ling, Gregor SchieleFirst submitted to arxiv…
Summary of Large-scale Multi-omic Biosequence Transformers For Modeling Peptide-nucleotide Interactions, by Sully F. Chen et al.
Large-Scale Multi-omic Biosequence Transformers for Modeling Peptide-Nucleotide Interactionsby Sully F. Chen, Robert J. Steele, Beakal…
Summary of Tcnformer: Temporal Convolutional Network Former For Short-term Wind Speed Forecasting, by Abid Hasan Zim et al.
TCNFormer: Temporal Convolutional Network Former for Short-Term Wind Speed Forecastingby Abid Hasan Zim, Aquib Iqbal,…
Summary of Automatic Differential Diagnosis Using Transformer-based Multi-label Sequence Classification, by Abu Adnan Sadi et al.
Automatic Differential Diagnosis using Transformer-Based Multi-Label Sequence Classificationby Abu Adnan Sadi, Mohammad Ashrafuzzaman Khan, Lubaba…