Missing Premise Test on MIP-MATH
25AccuracyPIR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PIRzero-shot-CoT=true, pass@1=true, mode=interactive2026.01 | 25 | 1.38 | |
| PIRzero-shot-CoT=true, pass@1=true, mode=interactive stronger US (gpt-4o-mini)2026.01 | 25 | 1.47 | |
| GPT-4o-minizero-shot-CoT=true, pass@1=true2026.01 | 13.76 | 1.47 | |
| PIRzero-shot-CoT=true, pass@1=true, mode=self-play2026.01 | 13.46 | 1.79 | |
| Reasoning Basezero-shot-CoT=true, pass@1=true2026.01 | 7.68 | 3.71 |