Asynchronous planning on NL-AAVE (test)
72.4AccuracyGPT-4o (zero-shot)
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-4o (zero-shot)Mode=zero-shot2026.02 | 72.4 | |
| Graph (40 steps) + NL (40 steps)Model=Qwen 1.5B, Stage 1=Graph (40 steps), Stage 2=NL (40 steps), Training Algorithm=GRPO2026.02 | 57.3 | |
| 7B (NL 40 steps)Model=Qwen 7B, Training steps=40 steps2026.02 | 57.3 | |
| NL only (80 steps)Model=Qwen 1.5B, Total Training steps=80 steps, Training Algorithm=GRPO2026.02 | 50.7 | |
| 3B (NL 40 steps)Model=Qwen 3B, Training steps=40 steps2026.02 | 40 | |
| GPT-4o-mini (zero-shot)Mode=zero-shot2026.02 | 28.9 | |
| NL (40 steps) + Graph (40 steps)Model=Qwen 1.5B, Stage 1=NL (40 steps), Stage 2=Graph (40 steps), Training Algorithm=GRPO2026.02 | 16.9 |