List your company

Explanation Faithfulness Evaluation on BiasQA (test)

20.7GreedyDPO + RM
13.52415.38717.2519.113Apr 7, 2025

Evaluation results

MethodLinks
DPO + RMBase Model=LLAMA-3.2-3B-IT, Training Method=DPO, Reward Model=SK-GEMMA-27B2025.0420.719.5
DPO + RMCBase Model=LLAMA-3.2-3B-IT, Training Method=DPO, Reward Model=SK-GEMMA-27B2025.0418.213.9
DPO + RMDBase Model=LLAMA-3.2-3B-IT, Training Method=DPO, Reward Model=SK-GEMMA-27B2025.0416.511.4
DPO + RMDBase Model=LLAMA-3.2-3B-IT, Training Method=DPO, Reward Model=SK-LLAMA-8B2025.0415.312.5
BaseBase Model=LLAMA-3.2-3B-IT, Training Method=Base, Reward Model=None2025.0414.917.2
DPO + RMBase Model=LLAMA-3.2-3B-IT, Training Method=DPO, Reward Model=SK-LLAMA-8B2025.0414.112.4
DPO + RMCBase Model=LLAMA-3.2-3B-IT, Training Method=DPO, Reward Model=SK-LLAMA-8B2025.0413.810.8