List your company

Chain-of-Thought Faithfulness Evaluation on Math Book

22.8Unfaithful Explanation RateDPO + RMC
22.30425.6522932.348Apr 7, 2025

Evaluation results

MethodLinks
DPO + RMCReward Model=SK-LLAMA-8B, Decoding=Greedy2025.0422.8
DPO + RMCReward Model=SK-GEMMA-27B, Decoding=Greedy2025.0423.6
DPO + RMDReward Model=SK-LLAMA-8B, Decoding=Greedy2025.0424.5
Base LLAMA-3.1-8B-ITReward Model=None, Decoding=Greedy2025.0424.8
DPO + RMReward Model=SK-LLAMA-8B, Decoding=Greedy2025.0425.7
Base LLAMA-3.1-8B-ITReward Model=None, Decoding=Maj@162025.0427.2
DPO + RMReward Model=SK-GEMMA-27B, Decoding=Greedy2025.0427.2
DPO + RMDReward Model=SK-GEMMA-27B, Decoding=Greedy2025.0428.3
DPO + RMCReward Model=SK-LLAMA-8B, Decoding=Maj@162025.0431.6
DPO + RMCReward Model=SK-GEMMA-27B, Decoding=Maj@162025.0432.5
DPO + RMDReward Model=SK-LLAMA-8B, Decoding=Maj@162025.0433.6
DPO + RMReward Model=SK-GEMMA-27B, Decoding=Maj@162025.0433.9
DPO + RMReward Model=SK-LLAMA-8B, Decoding=Maj@162025.0434
DPO + RMDReward Model=SK-GEMMA-27B, Decoding=Maj@162025.0435.2