# Constraint recall on Trip-planning windowed recall task Source: [Constraint recall on Trip-planning windowed recall task]() Collection index: [llms.txt]() Data updated: 2026-07-08T06:02:01.329Z Evaluation of model performance on the Trip-planning windowed recall task, specifically measuring Constraint recall using mean, min, and max constraints recalled. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Constraint recall | | Dataset (including any stated split) | Trip-planning windowed recall task | | Metric | Mean Constraints Recalled | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Mean Constraints Recalled](): Higher is better; unit: SCALAR. - [Min Constraints Recalled](): Higher is better; unit: SCALAR. - [Max Constraints Recalled](): Higher is better; unit: SCALAR. ## Recorded results | Method | Mean Constraints Recalled | Result date | Report paper | | --- | --- | --- | --- | | gpt-5-nano | 5 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5-mini | 5 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5 | 5 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5.5 | 5 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5-nano | 4.8 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5 | 4 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5.5 | 4 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5-mini | 3.6 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5-nano | 0 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5-nano | 0 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5-mini | 0 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5-mini | 0 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5 | 0 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5 | 0 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5.5 | 0 | Not recorded | 6a4dd9b24da6617fe9198c31 | | gpt-5.5 | 0 | Not recorded | 6a4dd9b24da6617fe9198c31 | ### gpt-5-nano Mean Constraints Recalled: 5. Result ID: 6a4de7cb60b88bb339d5e57b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Notes"}. This record does not assert independent reproduction. ### gpt-5-mini Mean Constraints Recalled: 5. Result ID: 6a4de7cb60b88bb339d5e57f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Notes"}. This record does not assert independent reproduction. ### gpt-5 Mean Constraints Recalled: 5. Result ID: 6a4de7cb60b88bb339d5e583. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Notes"}. This record does not assert independent reproduction. ### gpt-5.5 Mean Constraints Recalled: 5. Result ID: 6a4de7cb60b88bb339d5e587. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Notes"}. This record does not assert independent reproduction. ### gpt-5-nano Mean Constraints Recalled: 4.8. Result ID: 6a4de7cb60b88bb339d5e57c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Memory"}. This record does not assert independent reproduction. ### gpt-5 Mean Constraints Recalled: 4. Result ID: 6a4de7cb60b88bb339d5e584. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Memory"}. This record does not assert independent reproduction. ### gpt-5.5 Mean Constraints Recalled: 4. Result ID: 6a4de7cb60b88bb339d5e588. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Memory"}. This record does not assert independent reproduction. ### gpt-5-mini Mean Constraints Recalled: 3.6. Result ID: 6a4de7cb60b88bb339d5e580. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Memory"}. This record does not assert independent reproduction. ### gpt-5-nano Mean Constraints Recalled: 0. Result ID: 6a4de7cb60b88bb339d5e579. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Baseline"}. This record does not assert independent reproduction. ### gpt-5-nano Mean Constraints Recalled: 0. Result ID: 6a4de7cb60b88bb339d5e57a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Aware"}. This record does not assert independent reproduction. ### gpt-5-mini Mean Constraints Recalled: 0. Result ID: 6a4de7cb60b88bb339d5e57d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Baseline"}. This record does not assert independent reproduction. ### gpt-5-mini Mean Constraints Recalled: 0. Result ID: 6a4de7cb60b88bb339d5e57e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Aware"}. This record does not assert independent reproduction. ### gpt-5 Mean Constraints Recalled: 0. Result ID: 6a4de7cb60b88bb339d5e581. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Baseline"}. This record does not assert independent reproduction. ### gpt-5 Mean Constraints Recalled: 0. Result ID: 6a4de7cb60b88bb339d5e582. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Aware"}. This record does not assert independent reproduction. ### gpt-5.5 Mean Constraints Recalled: 0. Result ID: 6a4de7cb60b88bb339d5e585. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Baseline"}. This record does not assert independent reproduction. ### gpt-5.5 Mean Constraints Recalled: 0. Result ID: 6a4de7cb60b88bb339d5e586. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Condition":"Aware"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.