Summary of Representation Tuning, by Christopher M. Ackerman
Representation Tuningby Christopher M. AckermanFirst submitted to arxiv on: 11 Sep 2024CategoriesMain: Machine Learning (cs.LG)Secondary:…
Representation Tuningby Christopher M. AckermanFirst submitted to arxiv on: 11 Sep 2024CategoriesMain: Machine Learning (cs.LG)Secondary:…
A Practice of Post-Training on Llama-3 70B with Optimal Selection of Additional Language Mixture Ratioby…
FairHome: A Fair Housing and Fair Lending Datasetby Anusha Bagalkotkar, Aveek Karmakar, Gabriel Arnson, Ondrej…
SORSA: Singular Values and Orthonormal Regularized Singular Vectors Adaptation of Large Language Modelsby Yang CaoFirst…
Non-instructional Fine-tuning: Enabling Instruction-Following Capabilities in Pre-trained Language Models without Instruction-Following Databy Juncheng Xie, Shensian…
Learning Harmonized Representations for Speculative Samplingby Lefan Zhang, Xiaodan Wang, Yanhua Huang, Ruiwen XuFirst submitted…
Memory-Efficient LLM Training with Online Subspace Descentby Kaizhao Liang, Bo Liu, Lizhang Chen, Qiang LiuFirst…
LLMs are not Zero-Shot Reasoners for Biomedical Information Extractionby Aishik Nagar, Viktor Schlegel, Thanh-Tung Nguyen,…
Critique-out-Loud Reward Modelsby Zachary Ankner, Mansheej Paul, Brandon Cui, Jonathan D. Chang, Prithviraj AmmanabroluFirst submitted…
LLM Pruning and Distillation in Practice: The Minitron Approachby Sharath Turuvekere Sreenivas, Saurav Muralidharan, Raviraj…