List your company
ResearchFormerly WizWand

Truthfulness and Informativeness on TruthfulQA

78.46TruthfulQA ScoreChatGPT
20.542435.578750.61565.6513Jul 18, 2023Jul 24, 2023Jul 30, 2023Aug 5, 2023Aug 11, 2023Aug 17, 2023Aug 24, 2023
Updated 8mo ago

Evaluation results

MethodLinks
ChatGPT2023.0778.46
Llama 2-ChatSize=34B2023.0767.2
LLAMA 2 CHAT 34BAlignment=Instruct (aligned), Parameters=34B2023.0867.2
Llama 2-ChatSize=70B2023.0764.14
Llama 2-ChatSize=13B2023.0762.18
LLAMA 2 CHAT 13BAlignment=Instruct (aligned), Parameters=13B2023.0862.18
Llama 2-ChatSize=7B2023.0757.04
LLAMA 2 CHAT 7BAlignment=Instruct (aligned), Parameters=7B2023.0857.04
CODE LLAMA - INSTRUCT 34BAlignment=Instruct (aligned), Parameters=34B2023.0847.37
LLAMA 2 34BAlignment=Pretrained, Parameters=34B2023.0843.45
LLAMA 2 13BAlignment=Pretrained, Parameters=13B2023.0841.86
CODE LLAMA - INSTRUCT 13BAlignment=Instruct (aligned), Parameters=13B2023.0836.84
CODE LLAMA 34BAlignment=Pretrained, Parameters=34B2023.0834.64
LLAMA 2 7BAlignment=Pretrained, Parameters=7B2023.0833.29
CODE LLAMA 13BAlignment=Pretrained, Parameters=13B2023.0833.29
CODE LLAMA - INSTRUCT 7BAlignment=Instruct (aligned), Parameters=7B2023.0831.46
MPT-instructSize=7B2023.0729.99
MPT-instruct 7BAlignment=Instruct (aligned), Parameters=7B2023.0829.99
MPT 7BAlignment=Pretrained, Parameters=7B2023.0829.13
Falcon-instructSize=7B2023.0728.03
Falcon-instruct 7BAlignment=Instruct (aligned), Parameters=7B2023.0828.03
CODE LLAMA 7BAlignment=Pretrained, Parameters=7B2023.0826.18
Falcon 7BAlignment=Pretrained, Parameters=7B2023.0825.95
StarCoder (Python) 15.5BAlignment=Pretrained, Parameters=15.5B2023.0822.77