ResearchBenchmarksLLM Preference Alignment on PrefEvalFollow68.8AccPFCDRA36.24844.69953.1561.601Oct 13, 2025Evaluation ResultsMethodMethodLinksAccPFAccDAAccMismthmdmmieCDRA2025.1068.862.52127.737.515.2GRPO2025.106751.827.353.6171.8SFT2025.1066.95824.721.434.810.7CoT2025.1062.561.620.354.518.80.9TPO2025.1062.548.220.758.919.60Few-shotMode=Few-shotMode=Few-shot2025.1056.338.423.338.42.70.9Zero-shotMode=Zero-shotMode=Zero-shot2025.1037.510.728.78.94.50.9