List your company
ResearchFormerly WizWand

Question Answering on TruthfulQA (Accuracy Metric)

55.94AccuracyMistral-7B-INST
45.529648.232350.93553.6377Aug 27, 2024
Updated 5mo ago

Evaluation results

MethodLinks
Mistral-7B-INSTBase Model=Mistral-7B-INST, Alignment Strategy=Base, Alignment Data Prompts=HelpSteer22024.0855.94
RLHFBase Model=Mistral-7B-INST, Alignment Strategy=RLHF, Alignment Data Prompts=HelpSteer22024.0855.88
UNABase Model=Mistral-7B-INST, Alignment Strategy=UNA, Alignment Data Prompts=HelpSteer22024.0855.88
UNABase Model=Qwen2-1.5B-INST, Alignment Strategy=UNA, Alignment Data Prompts=HelpSteer22024.0847.08
RLHFBase Model=Qwen2-1.5B-INST, Alignment Strategy=RLHF, Alignment Data Prompts=HelpSteer22024.0846.93
Qwen2-1.5B-INSTBase Model=Qwen2-1.5B-INST, Alignment Strategy=Base, Alignment Data Prompts=HelpSteer22024.0845.93