Summary of Correlated Proxies: a New Definition and Improved Mitigation For Reward Hacking, by Cassidy Laidlaw et al.
Correlated Proxies: A New Definition and Improved Mitigation for Reward Hackingby Cassidy Laidlaw, Shivam Singhal,…
Summary of Enhancing Llm Safety Via Constrained Direct Preference Optimization, by Zixuan Liu et al.
Enhancing LLM Safety via Constrained Direct Preference Optimizationby Zixuan Liu, Xiaolin Sun, Zizhan ZhengFirst submitted…
Summary of Reward Model Learning Vs. Direct Policy Optimization: a Comparative Analysis Of Learning From Human Preferences, by Andi Nika et al.
Reward Model Learning vs. Direct Policy Optimization: A Comparative Analysis of Learning from Human Preferencesby Andi…
Summary of Arithmetic Control Of Llms For Diverse User Preferences: Directional Preference Alignment with Multi-objective Rewards, by Haoxiang Wang et al.
Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective Rewardsby Haoxiang…
Summary of Cogbench: a Large Language Model Walks Into a Psychology Lab, by Julian Coda-forno et al.
CogBench: a large language model walks into a psychology labby Julian Coda-Forno, Marcel Binz, Jane…
Summary of When Your Ais Deceive You: Challenges Of Partial Observability in Reinforcement Learning From Human Feedback, by Leon Lang et al.
When Your AIs Deceive You: Challenges of Partial Observability in Reinforcement Learning from Human Feedbackby…
Summary of Leveraging Domain Knowledge For Efficient Reward Modelling in Rlhf: a Case-study in E-commerce Opinion Summarization, by Swaroop Nath et al.
Leveraging Domain Knowledge for Efficient Reward Modelling in RLHF: A Case-Study in E-Commerce Opinion Summarizationby…
Summary of Back to Basics: Revisiting Reinforce Style Optimization For Learning From Human Feedback in Llms, by Arash Ahmadian et al.
Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMsby Arash…
Summary of Advancing Translation Preference Modeling with Rlhf: a Step Towards Cost-effective Solution, by Nuo Xu et al.
Advancing Translation Preference Modeling with RLHF: A Step Towards Cost-Effective Solutionby Nuo Xu, Jun Zhao,…
Summary of Active Preference Optimization For Sample Efficient Rlhf, by Nirjhar Das et al.
Active Preference Optimization for Sample Efficient RLHFby Nirjhar Das, Souradip Chakraborty, Aldo Pacchiano, Sayak Ray…