ResearchBenchmarksPreference Optimization Evaluation on UltraFeedback (test_prefs)Preference Optimization Evaluation on UltraFeedback (test_prefs)Follow57.65Pair AccuracyDDO-RM51.82653.33854.8556.362Apr 13, 2026Evaluation resultsMethodMethodLinksPair AccuracyAUCMean MarginDDO-RMSeed=3407Seed=34072026.0457.6554.2378.67DDO-RMSeed=13Seed=132026.0456.353.8851.96DDO-RMSeed=MeanSeed=Mean2026.0456.0253.8253.53DDO-RMSeed=42Seed=422026.0454.153.3529.95DPOSeed=42Seed=422026.0452.8553.3513.08DPOSeed=MeanSeed=Mean2026.0452.3853.1513.77DPOSeed=3407Seed=34072026.0452.2553.0814.39DPOSeed=13Seed=132026.0452.0553.0113.84