ResearchBenchmarksLLM Preference Alignment on DeepPrefFollow84.7AccPFCDRA20.53237.19153.8570.509Oct 13, 2025Evaluation ResultsMethodMethodLinksAccPFAccDAAccMismthmdmmieCDRA2025.1084.776.332.3476542.7GRPO2025.1083.770.330.746.358.734SFT2025.1083.37534.746.763.740.3CoT2025.1059.749.350.33925.30.7TPO2025.1055.336.356.329.715.70Few-shotMode=Few-shotMode=Few-shot2025.1049.732.761.32910.70.3Zero-shotMode=Zero-shotMode=Zero-shot2025.10236.7764.730