Factual Knowledge Question Answering on TruthfulQA (Acc, vbal, FP, TN, FN, TP)
83.3AccuracyDeepSeek-V3
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DeepSeek-V3Averaged over=three LLM raters2026.04 | 83.3 | 57.2 | 10.3 | 40 | 81.1 | 97.7 | |
| Grok-4Averaged over=three LLM raters2026.04 | 77.7 | 55.3 | 7.4 | 27.7 | 87.6 | 98.7 | |
| Llama4-MaverickAveraged over=three LLM raters2026.04 | 72.4 | 60.3 | 17.9 | 54.8 | 72.5 | 96.1 | |
| Qwen3Averaged over=three LLM raters2026.04 | 66 | 67.3 | 60.2 | 79.2 | 44.8 | 85.1 | |
| Llama3.1-8BAveraged over=three LLM raters2026.04 | 55.3 | 64 | 29.5 | 72 | 60.6 | 94 | |
| OLMo2-7BAveraged over=three LLM raters2026.04 | 41.8 | 66.9 | 39.9 | 83.3 | 51.2 | 93.4 | |
| Tulu3.1-8BAveraged over=three LLM raters2026.04 | 39 | 66.7 | 32.1 | 92.3 | 47.3 | 95.1 |