Factual Knowledge on MMLU-Pro
58.4EMGPT-4o-mini
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4o-minizero-shot-CoT=true, pass@1=true2026.01 | 58.4 | 0.61 | |
| PIRzero-shot-CoT=true, pass@1=true, mode=interactive stronger US (gpt-4o-mini)2026.01 | 52.87 | 1.32 | |
| Reasoning Basezero-shot-CoT=true, pass@1=true2026.01 | 51.21 | 2.04 | |
| PIRzero-shot-CoT=true, pass@1=true, mode=interactive2026.01 | 50.29 | 1.33 | |
| PIRzero-shot-CoT=true, pass@1=true, mode=self-play2026.01 | 50 | 1.31 |