# Driving Question Answering on NuPlanQA Source: [Driving Question Answering on NuPlanQA]() Collection index: [llms.txt]() Data updated: 2026-07-07T10:30:09.531Z Evaluation of model performance on the NuPlanQA dataset for Driving Question Answering tasks, typically measured by a general Score metric. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Driving Question Answering | | Dataset (including any stated split) | NuPlanQA | | Metric | Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Score | Result date | Report paper | | --- | --- | --- | --- | | ACE-Brain 0-8B | 91.7 | Not recorded | 6a4c881e85dba69fef8b28d9 | | GPT 5.4 | 87.5 | Not recorded | 6a4c881e85dba69fef8b28d9 | | ACE-Brain 0.5-8B | 86.7 | Not recorded | 6a4c881e85dba69fef8b28d9 | | Pelican VL-7B | 83.4 | Not recorded | 6a4c881e85dba69fef8b28d9 | | VeBrain 7B | 82.9 | Not recorded | 6a4c881e85dba69fef8b28d9 | | RoboBrain 2.0-7B | 82.8 | Not recorded | 6a4c881e85dba69fef8b28d9 | | Cosmos3 Nano | 82.5 | Not recorded | 6a4c881e85dba69fef8b28d9 | | Embodied R1.5 | 82 | Not recorded | 6a4c881e85dba69fef8b28d9 | | RynnBrain 8B | 81.8 | Not recorded | 6a4c881e85dba69fef8b28d9 | | RoboBrain 2.5-8B | 79.3 | Not recorded | 6a4c881e85dba69fef8b28d9 | | Vlaser 8B | 78.3 | Not recorded | 6a4c881e85dba69fef8b28d9 | | Claude Sonnet 4.6 | 78.2 | Not recorded | 6a4c881e85dba69fef8b28d9 | | MiMo Embodied-7B | 73.7 | Not recorded | 6a4c881e85dba69fef8b28d9 | | Gemini 2.5 Pro | 64.2 | Not recorded | 6a4c881e85dba69fef8b28d9 | ### ACE-Brain 0-8B Score: 91.7. Result ID: 6a4cd51d60b88bb339ca99ea. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT 5.4 Score: 87.5. Result ID: 6a4cd51d60b88bb339ca99e6. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ACE-Brain 0.5-8B Score: 86.7. Result ID: 6a4cd51d60b88bb339ca99e9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Pelican VL-7B Score: 83.4. Result ID: 6a4cd51d60b88bb339ca99f0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### VeBrain 7B Score: 82.9. Result ID: 6a4cd51d60b88bb339ca99f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### RoboBrain 2.0-7B Score: 82.8. Result ID: 6a4cd51d60b88bb339ca99f3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Cosmos3 Nano Score: 82.5. Result ID: 6a4cd51d60b88bb339ca99eb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Embodied R1.5 Score: 82. Result ID: 6a4cd51d60b88bb339ca99ec. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### RynnBrain 8B Score: 81.8. Result ID: 6a4cd51d60b88bb339ca99ed. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### RoboBrain 2.5-8B Score: 79.3. Result ID: 6a4cd51d60b88bb339ca99f2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Vlaser 8B Score: 78.3. Result ID: 6a4cd51d60b88bb339ca99ee. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Claude Sonnet 4.6 Score: 78.2. Result ID: 6a4cd51d60b88bb339ca99e8. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MiMo Embodied-7B Score: 73.7. Result ID: 6a4cd51d60b88bb339ca99ef. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Gemini 2.5 Pro Score: 64.2. Result ID: 6a4cd51d60b88bb339ca99e7. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.