List your company

Chain-of-Thought Faithfulness Evaluation on BiasQA

2.4Unfaithful Explanation RateDPO + RMD
1.4967.59813.719.802Apr 7, 2025

Evaluation results

MethodLinks
DPO + RMDReward Model=SK-LLAMA-8B, Decoding=Maj@162025.042.4
DPO + RMCReward Model=SK-LLAMA-8B, Decoding=Maj@162025.043.9
DPO + RMCReward Model=SK-LLAMA-8B, Decoding=Greedy2025.047.4
DPO + RMDReward Model=SK-GEMMA-27B, Decoding=Maj@162025.047.5
DPO + RMDReward Model=SK-LLAMA-8B, Decoding=Greedy2025.048
DPO + RMReward Model=SK-LLAMA-8B, Decoding=Maj@162025.049.8
DPO + RMDReward Model=SK-GEMMA-27B, Decoding=Greedy2025.0410.7
DPO + RMCReward Model=SK-GEMMA-27B, Decoding=Maj@162025.0411.7
DPO + RMCReward Model=SK-GEMMA-27B, Decoding=Greedy2025.0412.3
DPO + RMReward Model=SK-LLAMA-8B, Decoding=Greedy2025.0413.2
Base LLAMA-3.1-8B-ITReward Model=None, Decoding=Greedy2025.0413.7
Base LLAMA-3.1-8B-ITReward Model=None, Decoding=Maj@162025.0414.1
DPO + RMReward Model=SK-GEMMA-27B, Decoding=Greedy2025.0420.8
DPO + RMReward Model=SK-GEMMA-27B, Decoding=Maj@162025.0425