Summary of Recurrentgemma: Moving Past Transformers For Efficient Open Language Models, by Aleksandar Botev et al.
RecurrentGemma: Moving Past Transformers for Efficient Open Language Modelsby Aleksandar Botev, Soham De, Samuel L…
Summary of Minicpm: Unveiling the Potential Of Small Language Models with Scalable Training Strategies, by Shengding Hu et al.
MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiesby Shengding Hu, Yuge…
Summary of Physics Of Language Models: Part 3.3, Knowledge Capacity Scaling Laws, by Zeyuan Allen-zhu and Yuanzhi Li
Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Lawsby Zeyuan Allen-Zhu, Yuanzhi LiFirst submitted…
Summary of Plug and Play with Prompts: a Prompt Tuning Approach For Controlling Text Generation, by Rohan Deepak Ajwani et al.
Plug and Play with Prompts: A Prompt Tuning Approach for Controlling Text Generationby Rohan Deepak…
Summary of What Happens When Small Is Made Smaller? Exploring the Impact Of Compression on Small Data Pretrained Language Models, by Busayo Awobade et al.
What Happens When Small Is Made Smaller? Exploring the Impact of Compression on Small Data…
Summary of Investigating Regularization Of Self-play Language Models, by Reda Alami et al.
Investigating Regularization of Self-Play Language Modelsby Reda Alami, Abdalgader Abubaker, Mastane Achab, Mohamed El Amine…
Summary of Do Sentence Transformers Learn Quasi-geospatial Concepts From General Text?, by Ilya Ilyankou et al.
Do Sentence Transformers Learn Quasi-Geospatial Concepts from General Text?by Ilya Ilyankou, Aldo Lipani, Stefano Cavazzi,…
Summary of Advancing Llm Reasoning Generalists with Preference Trees, by Lifan Yuan et al.
Advancing LLM Reasoning Generalists with Preference Treesby Lifan Yuan, Ganqu Cui, Hanbin Wang, Ning Ding,…
Summary of Asymptotics Of Language Model Alignment, by Joy Qiping Yang and Salman Salamatian and Ziteng Sun and Ananda Theertha Suresh and Ahmad Beirami
Asymptotics of Language Model Alignmentby Joy Qiping Yang, Salman Salamatian, Ziteng Sun, Ananda Theertha Suresh,…
Summary of Extensive Self-contrast Enables Feedback-free Language Model Alignment, by Xiao Liu et al.
Extensive Self-Contrast Enables Feedback-Free Language Model Alignmentby Xiao Liu, Xixuan Song, Yuxiao Dong, Jie TangFirst…