Summary of Training and Evaluating Language Models with Template-based Data Generation, by Yifan Zhang
Training and Evaluating Language Models with Template-based Data Generationby Yifan ZhangFirst submitted to arxiv on:…
Summary of Pushing the Limits Of Large Language Model Quantization Via the Linearity Theorem, by Vladimir Malinovskii et al.
Pushing the Limits of Large Language Model Quantization via the Linearity Theoremby Vladimir Malinovskii, Andrei…
Summary of On Limitations Of Llm As Annotator For Low Resource Languages, by Suramya Jadhav et al.
On Limitations of LLM as Annotator for Low Resource Languagesby Suramya Jadhav, Abhay Shanbhag, Amogh…
Summary of Clover: Cross-layer Orthogonal Vectors Pruning and Fine-tuning, by Fanxu Meng et al.
CLOVER: Cross-Layer Orthogonal Vectors Pruning and Fine-Tuningby Fanxu Meng, Pingzhi Tang, Fan jiang, Muhan ZhangFirst…
Summary of Cautious Optimizers: Improving Training with One Line Of Code, by Kaizhao Liang et al.
Cautious Optimizers: Improving Training with One Line of Codeby Kaizhao Liang, Lizhang Chen, Bo Liu,…
Summary of Hymba: a Hybrid-head Architecture For Small Language Models, by Xin Dong et al.
Hymba: A Hybrid-head Architecture for Small Language Modelsby Xin Dong, Yonggan Fu, Shizhe Diao, Wonmin…
Summary of Evaluating Llms Capabilities Towards Understanding Social Dynamics, by Anique Tahir et al.
Evaluating LLMs Capabilities Towards Understanding Social Dynamicsby Anique Tahir, Lu Cheng, Manuel Sandoval, Yasin N.…
Summary of Deriving Activation Functions Using Integration, by Allen Hao Huang et al.
Deriving Activation Functions Using Integrationby Allen Hao Huang, Imanol SchlagFirst submitted to arxiv on: 20…
Summary of Crow: Eliminating Backdoors From Large Language Models Via Internal Consistency Regularization, by Nay Myat Min et al.
CROW: Eliminating Backdoors from Large Language Models via Internal Consistency Regularizationby Nay Myat Min, Long…
Summary of Redpajama: An Open Dataset For Training Large Language Models, by Maurice Weber et al.
RedPajama: an Open Dataset for Training Large Language Modelsby Maurice Weber, Daniel Fu, Quentin Anthony,…