Structured Planning on WorkArena-NLP
40.6Field AccuracyGPT-5
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-5Evaluation Protocol=zero-shot format-constrained prompting2026.06 | 40.6 | |
| Claude Sonnet 4.5Evaluation Protocol=zero-shot format-constrained prompting2026.06 | 39.8 | |
| Claude Haiku 4.5Evaluation Protocol=zero-shot format-constrained prompting2026.06 | 39.6 | |
| Gemma-4-31BEvaluation Protocol=zero-shot format-constrained prompting2026.06 | 38.6 | |
| Llama-3.1-70BEvaluation Protocol=zero-shot format-constrained prompting2026.06 | 38 | |
| Qwen3-8BEvaluation Protocol=zero-shot2026.06 | 37 | |
| Qwen3-8BEvaluation Protocol=GRPO from base2026.06 | 37 | |
| DeepSeek-R1-Distill-32BEvaluation Protocol=zero-shot format-constrained prompting2026.06 | 31.2 | |
| OLMo-3-7BEvaluation Protocol=zero-shot format-constrained prompting2026.06 | 12.8 |