Knowledge Reasoning on MMLU 57 subjects (test)
74.3AccuracyUTS-guided system
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| UTS-guided systemT (Temperature)=1.02026.02 | 74.3 | 0.02 | 1.592 | |
| UTS-guided systemT (Temperature)=0.52026.02 | 73.73 | 0.01 | 1.564 | |
| UTS-guided systemT (Temperature)=1.52026.02 | 72.92 | 0.07 | 1.63 | |
| UTS-guided systemT (Temperature)=2.02026.02 | 72.82 | 0.17 | 1.628 | |
| UTS-guided systemT (Temperature)=2.52026.02 | 72.52 | 0.15 | 1.628 | |
| UTS-guided systemT (Temperature)=3.02026.02 | 72.49 | 0.4 | 1.623 |