Comparing Bad Apples to Good Oranges: Aligning Large Language Models via Joint Preference Optimizationby Hritik…
Towards a Robust Retrieval-Based Summarization Systemby Shengjie Liu, Jing Wu, Jingyuan Bao, Wenyi Wang, Naira…
Disentangling Length from Quality in Direct Preference Optimizationby Ryan Park, Rafael Rafailov, Stefano Ermon, Chelsea…
The N+ Implementation Details of RLHF with PPO: A Case Study on TL;DR Summarizationby Shengyi…
Improving Sequence-to-Sequence Models for Abstractive Text Summarization Using Meta Heuristic Approachesby Aditya Saxena, Ashutosh RanjanFirst…
Can large language models explore in-context?by Akshay Krishnamurthy, Keegan Harris, Dylan J. Foster, Cyril Zhang,…
PARAMANU-AYN: Pretrain from scratch or Continual Pretraining of LLMs for Legal Domain Adaptation?by Mitodru Niyogi,…
Towards Unsupervised Question Answering System with Multi-level Summarization for Legal Textby M Manvith Prabhu, Haricharana…
SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of…
From Instructions to Constraints: Language Model Alignment with Automatic Constraint Verificationby Fei Wang, Chao Shang,…