Truthfulness on TruthfulQA MC2
56.4Truthfulness Score (MC2)Qwen2.5-7B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-7BParameters=7B2026.05 | 56.4 | |
| Qwen3-4BParameters=4B2026.05 | 53.5 | |
| Qwen3.5-4BParameters=4B2026.05 | 52.1 | |
| FPModel=Dream-Instruct, Quantization=Full Precision2026.06 | 47.12 | |
| OLMo-3-7BParameters=7B2026.05 | 47 | |
| FAIR-CalibModel=Dream-Instruct, Quantization=W4A42026.06 | 46.99 | |
| Mellum 2Parameters=2.5B/12B2026.05 | 44.5 | |
| FlatQuantModel=Dream-Instruct, Quantization=W4A42026.06 | 44.27 | |
| FPModel=Dream-Base, Quantization=Full Precision2026.06 | 44.17 | |
| FAIR-CalibModel=Dream-Base, Quantization=W4A42026.06 | 43.4 | |
| FlatQuantModel=Dream-Base, Quantization=W4A42026.06 | 43.23 | |
| RTNModel=Dream-Base, Quantization=W4A42026.06 | 41.42 | |
| RTNModel=Dream-Instruct, Quantization=W4A42026.06 | 41.12 | |
| QuaRotModel=Dream-Base, Quantization=W4A42026.06 | 40.4 | |
| QuaRotModel=Dream-Instruct, Quantization=W4A42026.06 | 39.92 |