Reasoning on GPQA Ambiguity-Augmented (subset of 200 samples)
44Accuracy@1DisambiguSLM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DisambiguSLM2026.04 | 44 | 47.3 | 11.2 | |
| SPO2026.04 | 43.6 | 46.8 | 17.5 | |
| OPRO2026.04 | 43.3 | 46.5 | 18.9 | |
| Step-back2026.04 | 42.4 | 45 | 20.8 | |
| CoT2026.04 | 41.6 | 43.9 | 22.1 | |
| PromptAgent2026.04 | 41.3 | 44.1 | 20.4 | |
| APE2026.04 | 41.1 | 43.8 | 21.6 | |
| PromptBreeder2026.04 | 40.9 | 43 | 21.1 | |
| Rephrase2026.04 | 40.2 | 42.1 | 23.4 | |
| TextGrad2026.04 | 40.2 | 42.6 | 22.3 | |
| Naïve prompting2026.04 | 38.9 | 40.2 | 24.7 |