Psychometric Predictive Power on SAP All
11.7MVRRsurprisal update
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| surprisal updateModel=G2-sm2026.04 | 11.7 | 1.1 | 7.8 | 12 | 4.5 | |
| surprisal updateModel=OT-125m2026.04 | 11.5 | 0.4 | 3.8 | 11.6 | 4.5 | |
| surprisal updateModel=G2-xl2026.04 | 11.4 | 0.8 | 10.5 | 12.3 | 4.2 | |
| surprisal updateModel=G2-lg2026.04 | 11.3 | 0.7 | 10.5 | 14.1 | 3.2 | |
| surprisal updateModel=G2-md2026.04 | 10.8 | 0.8 | 12.5 | 13.6 | 4.9 | |
| surprisal updateModel=PT-1b2026.04 | 9.5 | 0.6 | 1.8 | 9.1 | 2.9 | |
| surprisal updateModel=PT-410m2026.04 | 8.9 | 0.1 | 2.4 | 14 | 9.3 | |
| surprisal updateModel=PT-6.9b2026.04 | 8.5 | 2.2 | 1.9 | 11.6 | 8.9 | |
| surprisal updateModel=OT-13b2026.04 | 8.4 | 0.4 | 5.5 | 8.4 | 7.3 | |
| surprisal updateModel=OT-2.7b2026.04 | 8.3 | 0.5 | 6.3 | 11.1 | 4.9 | |
| surprisal updateModel=OT-6.7b2026.04 | 8.2 | 0.8 | 5.9 | 10.1 | 5.6 | |
| surprisal updateModel=OT-66b2026.04 | 7.9 | 0.6 | 4.3 | 10.7 | 6.9 | |
| surprisal updateModel=OT-1.3b2026.04 | 7.8 | 0.6 | 6.8 | 12.7 | 4.8 | |
| surprisal updateModel=PT-160m2026.04 | 7.8 | 1.5 | 11.3 | 6.7 | 5.8 | |
| surprisal updateModel=PT-70m2026.04 | 6.8 | 1.6 | 3.5 | 9.6 | 2.4 | |
| surprisal updateModel=PT-12b2026.04 | 6.8 | 1 | 2.7 | 8.2 | 10.8 | |
| surprisal updateModel=OT-30b2026.04 | 6.7 | 0.7 | 5.9 | 7.3 | 7.8 | |
| surprisal updateModel=PT-1.4b2026.04 | 6 | 1.5 | 1.1 | 7 | 6.2 | |
| surprisal updateModel=PT-2.8b2026.04 | 5.8 | 0.1 | 4.3 | 6.9 | 4.8 |