Constraint recall on Trip-planning windowed recall task
5Mean Constraints Recalledgpt-5-nano
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| gpt-5-nanoCondition=Notes2026.07 | 5 | 5 | 5 | |
| gpt-5-miniCondition=Notes2026.07 | 5 | 5 | 5 | |
| gpt-5Condition=Notes2026.07 | 5 | 5 | 5 | |
| gpt-5.5Condition=Notes2026.07 | 5 | 5 | 5 | |
| gpt-5-nanoCondition=Memory2026.07 | 4.8 | 4 | 5 | |
| gpt-5Condition=Memory2026.07 | 4 | 3 | 5 | |
| gpt-5.5Condition=Memory2026.07 | 4 | 3 | 5 | |
| gpt-5-miniCondition=Memory2026.07 | 3.6 | 3 | 5 | |
| gpt-5-nanoCondition=Baseline2026.07 | 0 | 0 | 0 | |
| gpt-5-nanoCondition=Aware2026.07 | 0 | 0 | 0 | |
| gpt-5-miniCondition=Baseline2026.07 | 0 | 0 | 0 | |
| gpt-5-miniCondition=Aware2026.07 | 0 | 0 | 0 | |
| gpt-5Condition=Baseline2026.07 | 0 | 0 | 0 | |
| gpt-5Condition=Aware2026.07 | 0 | 0 | 0 | |
| gpt-5.5Condition=Baseline2026.07 | 0 | 0 | 0 | |
| gpt-5.5Condition=Aware2026.07 | 0 | 0 | 0 |