Summary of A Dynamical Model Of Neural Scaling Laws, by Blake Bordelon et al.
A Dynamical Model of Neural Scaling Lawsby Blake Bordelon, Alexander Atanasov, Cengiz PehlevanFirst submitted to…
Summary of Towards Trustable Language Models: Investigating Information Quality Of Large Language Models, by Rick Rejeleene et al.
Towards Trustable Language Models: Investigating Information Quality of Large Language Modelsby Rick Rejeleene, Xiaowei Xu,…
Summary of Scaling Laws For Forgetting When Fine-tuning Large Language Models, by Damjan Kalajdzievski
Scaling Laws for Forgetting When Fine-Tuning Large Language Modelsby Damjan KalajdzievskiFirst submitted to arxiv on:…
Summary of Deepseek Llm: Scaling Open-source Language Models with Longtermism, by Deepseek-ai: Xiao Bi et al.
DeepSeek LLM: Scaling Open-Source Language Models with Longtermismby DeepSeek-AI, Xiao Bi, Deli Chen, Guanting Chen,…
Summary of Beyond Chinchilla-optimal: Accounting For Inference in Language Model Scaling Laws, by Nikhil Sardana and Jacob Portes and Sasha Doubov and Jonathan Frankle
Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Lawsby Nikhil Sardana, Jacob Portes, Sasha…