List your company

Truthfulness Evaluation on TruthfulQA (Normalized Accuracy)

58.76Normalized AccuracyIPO
43.4247.402551.38555.3675Dec 13, 2024Jan 8, 2025Feb 3, 2025Mar 1, 2025Mar 27, 2025Apr 22, 2025May 18, 2025

Evaluation results

MethodLinks
IPOBase model=Qwen-2 instruct 7B2025.0558.76—
SamPOBase model=Qwen-2 instruct 7B2025.0558.44—
SGDPOBase model=Qwen-2 instruct 7B2025.0558.06—
NCABase model=Qwen-2 instruct 7B2025.0557.82—
BCOBase model=Qwen-2 instruct 7B2025.0557.76—
DPOBase model=Qwen-2 instruct 7B2025.0557.74—
TDPOBase model=Qwen-2 instruct 7B2025.0557.63—
SFTBase model=Qwen-2 instruct 7B2025.0557.34—
Llama 3-8B E8T2Shots=0-shot2024.1244.22—
Llama 3-8BShots=0-shot2024.1244.01—
HATified-SFTShots=6-shot2026.03—17.6
Llama-InstructShots=6-shot2026.03—19.1