Summary of Flipguard: Defending Preference Alignment Against Update Regression with Constrained Optimization, by Mingye Zhu et al.
FlipGuard: Defending Preference Alignment against Update Regression with Constrained Optimizationby Mingye Zhu, Yi Liu, Quan…