ResearchTasksTwo-objective simultaneous preference alignmentTwo-objective simultaneous preference alignmentFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updatedMix-SafeRLHF-UltraFeedbackMORA96.54Harmless Rate8May 13, 2026