Summary of Gzip Predicts Data-dependent Scaling Laws, by Rohan Pandey
gzip Predicts Data-dependent Scaling Lawsby Rohan PandeyFirst submitted to arxiv on: 26 May 2024CategoriesMain: Computation…
Summary of Scaling-laws For Large Time-series Models, by Thomas D. P. Edwards et al.
Scaling-laws for Large Time-series Modelsby Thomas D. P. Edwards, James Alvey, Justin Alsing, Nam H.…
Summary of Observational Scaling Laws and the Predictability Of Language Model Performance, by Yangjun Ruan et al.
Observational Scaling Laws and the Predictability of Language Model Performanceby Yangjun Ruan, Chris J. Maddison,…
Summary of Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory, by Xueyan Niu et al.
Beyond Scaling Laws: Understanding Transformer Performance with Associative Memoryby Xueyan Niu, Bo Bai, Lei Deng,…
Summary of Scaling and Renormalization in High-dimensional Regression, by Alexander Atanasov et al.
Scaling and renormalization in high-dimensional regressionby Alexander Atanasov, Jacob A. Zavatone-Veth, Cengiz PehlevanFirst submitted to…
Summary of Kan: Kolmogorov-arnold Networks, by Ziming Liu et al.
KAN: Kolmogorov-Arnold Networksby Ziming Liu, Yixuan Wang, Sachin Vaidya, Fabian Ruehle, James Halverson, Marin Soljačić,…
Summary of More Compute Is What You Need, by Zhen Guo
More Compute Is What You Needby Zhen GuoFirst submitted to arxiv on: 30 Apr 2024CategoriesMain:…
Summary of An Exactly Solvable Model For Emergence and Scaling Laws in the Multitask Sparse Parity Problem, by Yoonsoo Nam et al.
An exactly solvable model for emergence and scaling laws in the multitask sparse parity problemby…
Summary of Adversarial Robustness Limits Via Scaling-law and Human-alignment Studies, by Brian R. Bartoldson et al.
Adversarial Robustness Limits via Scaling-Law and Human-Alignment Studiesby Brian R. Bartoldson, James Diffenderfer, Konstantinos Parasyris,…
Summary of Scaling Laws For Data Filtering — Data Curation Cannot Be Compute Agnostic, by Sachin Goyal et al.
Scaling Laws for Data Filtering – Data Curation cannot be Compute Agnosticby Sachin Goyal, Pratyush…