Summary of When Attention Sink Emerges in Language Models: An Empirical View, by Xiangming Gu et al.
When Attention Sink Emerges in Language Models: An Empirical Viewby Xiangming Gu, Tianyu Pang, Chao…
Summary of A Stochastic Approach to Bi-level Optimization For Hyperparameter Optimization and Meta Learning, by Minyoung Kim et al.
A Stochastic Approach to Bi-Level Optimization for Hyperparameter Optimization and Meta Learningby Minyoung Kim, Timothy…
Summary of Neural Quasiprobabilistic Likelihood Ratio Estimation with Negatively Weighted Data, by Matthew Drnevich et al.
Neural Quasiprobabilistic Likelihood Ratio Estimation with Negatively Weighted Databy Matthew Drnevich, Stephen Jiggins, Judith Katzy,…
Summary of Mvg-crps: a Robust Loss Function For Multivariate Probabilistic Forecasting, by Vincent Zhihao Zheng et al.
MVG-CRPS: A Robust Loss Function for Multivariate Probabilistic Forecastingby Vincent Zhihao Zheng, Lijun SunFirst submitted…
Summary of Path-minimizing Latent Odes For Improved Extrapolation and Inference, by Matt L. Sampson et al.
Path-minimizing Latent ODEs for improved extrapolation and inferenceby Matt L. Sampson, Peter MelchiorFirst submitted to…
Summary of Towards Cross-domain Few-shot Graph Anomaly Detection, by Jiazhen Chen et al.
Towards Cross-domain Few-shot Graph Anomaly Detectionby Jiazhen Chen, Sichao Fu, Zhibin Zhang, Zheng Ma, Mingbin…
Summary of Transformers Provably Solve Parity Efficiently with Chain Of Thought, by Juno Kim and Taiji Suzuki
Transformers Provably Solve Parity Efficiently with Chain of Thoughtby Juno Kim, Taiji SuzukiFirst submitted to…
Summary of Upper Bounds For Learning in Reproducing Kernel Hilbert Spaces For Non Iid Samples, by Priyanka Roy and Susanne Saminger-platz
Upper Bounds for Learning in Reproducing Kernel Hilbert Spaces for Non IID Samplesby Priyanka Roy,…
Summary of Simultaneous Weight and Architecture Optimization For Neural Networks, by Zitong Huang et al.
Simultaneous Weight and Architecture Optimization for Neural Networksby Zitong Huang, Mansooreh Montazerin, Ajitesh SrivastavaFirst submitted…
Summary of A Closer Look at Machine Unlearning For Large Language Models, by Xiaojian Yuan et al.
A Closer Look at Machine Unlearning for Large Language Modelsby Xiaojian Yuan, Tianyu Pang, Chao…