Truthfulness and Informativeness on TruthfulQA
78.46TruthfulQA ScoreChatGPT
Evaluation Results
| Method | Links | |
|---|---|---|
| ChatGPT2023.07 | 78.46 | |
| Llama 2-ChatSize=34B2023.07 | 67.2 | |
| LLAMA 2 CHAT 34BAlignment=Instruct (aligned), Parameters=34B2023.08 | 67.2 | |
| Llama 2-ChatSize=70B2023.07 | 64.14 | |
| Llama 2-ChatSize=13B2023.07 | 62.18 | |
| LLAMA 2 CHAT 13BAlignment=Instruct (aligned), Parameters=13B2023.08 | 62.18 | |
| Llama 2-ChatSize=7B2023.07 | 57.04 | |
| LLAMA 2 CHAT 7BAlignment=Instruct (aligned), Parameters=7B2023.08 | 57.04 | |
| CODE LLAMA - INSTRUCT 34BAlignment=Instruct (aligned), Parameters=34B2023.08 | 47.37 | |
| LLAMA 2 34BAlignment=Pretrained, Parameters=34B2023.08 | 43.45 | |
| LLAMA 2 13BAlignment=Pretrained, Parameters=13B2023.08 | 41.86 | |
| CODE LLAMA - INSTRUCT 13BAlignment=Instruct (aligned), Parameters=13B2023.08 | 36.84 | |
| CODE LLAMA 34BAlignment=Pretrained, Parameters=34B2023.08 | 34.64 | |
| LLAMA 2 7BAlignment=Pretrained, Parameters=7B2023.08 | 33.29 | |
| CODE LLAMA 13BAlignment=Pretrained, Parameters=13B2023.08 | 33.29 | |
| CODE LLAMA - INSTRUCT 7BAlignment=Instruct (aligned), Parameters=7B2023.08 | 31.46 | |
| MPT-instructSize=7B2023.07 | 29.99 | |
| MPT-instruct 7BAlignment=Instruct (aligned), Parameters=7B2023.08 | 29.99 | |
| MPT 7BAlignment=Pretrained, Parameters=7B2023.08 | 29.13 | |
| Falcon-instructSize=7B2023.07 | 28.03 | |
| Falcon-instruct 7BAlignment=Instruct (aligned), Parameters=7B2023.08 | 28.03 | |
| CODE LLAMA 7BAlignment=Pretrained, Parameters=7B2023.08 | 26.18 | |
| Falcon 7BAlignment=Pretrained, Parameters=7B2023.08 | 25.95 | |
| StarCoder (Python) 15.5BAlignment=Pretrained, Parameters=15.5B2023.08 | 22.77 |