ResearchBenchmarksKnowledge on GPQA (GPQA, AVG)Knowledge on GPQA (GPQA, AVG)Follow36.36GPQA ScoreHT-MNPO25.85628.58331.3134.037Sep 27, 2025Evaluation resultsMethodMethodLinksGPQA ScoreAverage ScoreHT-MNPOReward Model=Skywork-R...Reward Model=Skywork-Reward-V22025.0936.3671.8TD-MNPO2025.0933.3371.08SimPO2025.0932.3269.6HT-MNPOReward Model=Athene-RM-8BReward Model=Athene-RM-8B2025.0930.8170.99HT-MNPOReward Model=ArmoRM-Ll...Reward Model=ArmoRM-Llama32025.0929.870.83DPO2025.0929.2970.68SFT Model2025.0928.2870.28INPO2025.0927.7870.25SPPO2025.0926.2670.19