Summary of Online Bandit Learning with Offline Preference Data, by Akhil Agnihotri et al.
Online Bandit Learning with Offline Preference Databy Akhil Agnihotri, Rahul Jain, Deepak Ramachandran, Zheng WenFirst…
Summary of It Takes Two: on the Seamlessness Between Reward and Policy Model in Rlhf, by Taiming Lu et al.
It Takes Two: On the Seamlessness between Reward and Policy Model in RLHFby Taiming Lu,…
Summary of Optune: Efficient Online Preference Tuning, by Lichang Chen et al.
OPTune: Efficient Online Preference Tuningby Lichang Chen, Jiuhai Chen, Chenxi Liu, John Kirchenbauer, Davit Soselia,…
Summary of Reinforcement Learning From Human Feedback Without Reward Inference: Model-free Algorithm and Instance-dependent Analysis, by Qining Zhang et al.
Reinforcement Learning from Human Feedback without Reward Inference: Model-Free Algorithm and Instance-Dependent Analysisby Qining Zhang,…
Summary of Scaling Laws For Reward Model Overoptimization in Direct Alignment Algorithms, by Rafael Rafailov et al.
Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithmsby Rafael Rafailov, Yaswanth Chittepu, Ryan…
Summary of Aligning Large Language Models Via Fine-grained Supervision, by Dehong Xu et al.
Aligning Large Language Models via Fine-grained Supervisionby Dehong Xu, Liang Qiu, Minseok Kim, Faisal Ladhak,…
Summary of Adaptive Preference Scaling For Reinforcement Learning with Human Feedback, by Ilgee Hong et al.
Adaptive Preference Scaling for Reinforcement Learning with Human Feedbackby Ilgee Hong, Zichong Li, Alexander Bukharin,…
Summary of Self-improving Robust Preference Optimization, by Eugene Choi et al.
Self-Improving Robust Preference Optimizationby Eugene Choi, Arash Ahmadian, Matthieu Geist, Oilvier Pietquin, Mohammad Gheshlaghi AzarFirst…
Summary of Exploratory Preference Optimization: Harnessing Implicit Q*-approximation For Sample-efficient Rlhf, by Tengyang Xie et al.
Exploratory Preference Optimization: Harnessing Implicit Q*-Approximation for Sample-Efficient RLHFby Tengyang Xie, Dylan J. Foster, Akshay…
Summary of Group Robust Preference Optimization in Reward-free Rlhf, by Shyam Sundhar Ramesh et al.
Group Robust Preference Optimization in Reward-free RLHFby Shyam Sundhar Ramesh, Yifan Hu, Iason Chaimalas, Viraj…