Knowledge on TruthfulQA
60.66ScoreUM-187k
Evaluation Results
| Method | Links | |
|---|---|---|
| UM-187kBackbone=Apertus-8B-SFT, Evaluation Protocol=0-shot2025.11 | 60.66 | |
| UM-190kBackbone=Apertus-8B-SFT, Evaluation Protocol=0-shot2025.11 | 60.57 | |
| UM-170kBackbone=Apertus-8B-SFT, Evaluation Protocol=0-shot2025.11 | 58.23 | |
| TuluDPOBackbone=Apertus-8B-SFT, Evaluation Protocol=0-shot2025.11 | 56.28 | |
| CodePrefBackbone=Apertus-8B-SFT, Evaluation Protocol=0-shot2025.11 | 56.21 | |
| UltraFBBackbone=Apertus-8B-SFT, Evaluation Protocol=0-shot2025.11 | 55.87 | |
| ORPOBackbone=Apertus-8B-SFT, Evaluation Protocol=0-shot2025.11 | 55.62 | |
| HelpSteerBackbone=Apertus-8B-SFT, Evaluation Protocol=0-shot2025.11 | 54.71 | |
| SFTBackbone=Apertus-8B-SFT, Evaluation Protocol=0-shot2025.11 | 54.21 | |
| UM-187kshots=0-shot2025.11 | 50.38 | |
| UM-190kshots=0-shot2025.11 | 50.24 | |
| UM-170kshots=0-shot2025.11 | 48.1 | |
| Sumi-7BParadigm=Uniform Diffusion, Training Tokens=1.5T, Training Data=Fully Released, Evaluation protocol=Evaluated under our protocol, Shots=02026.06 | 46.6 | |
| LLaDA-8BParadigm=Masked Diffusion, Training Tokens=2.3T, Training Data=Not Released, Evaluation protocol=Reported by prior work, Shots=02026.06 | 46.1 | |
| TuluDPOshots=0-shot2025.11 | 45.73 | |
| ORPOshots=0-shot2025.11 | 45.5 | |
| CodePrefshots=0-shot2025.11 | 44.43 | |
| Llama 3-8BParadigm=AR, Training Tokens=15T, Training Data=Not Released, Evaluation protocol=Reported by prior work, Shots=02026.06 | 44 | |
| HelpSteershots=0-shot2025.11 | 41.19 | |
| SFTshots=0-shot2025.11 | 40.94 | |
| UltraFBshots=0-shot2025.11 | 39.18 | |
| Llama 2-7BParadigm=AR, Training Tokens=2T, Training Data=Not Released, Evaluation protocol=Evaluated under our protocol, Shots=02026.06 | 38.8 | |
| OLMo-7BParadigm=AR, Training Tokens=2.5T, Training Data=Fully Released, Evaluation protocol=Evaluated under our protocol, Shots=02026.06 | 35.9 | |
| Falcon-7BParadigm=AR, Training Tokens=1.5T, Training Data=Partially Released, Evaluation protocol=Evaluated under our protocol, Shots=02026.06 | 34.3 |