# Static Spatial Reasoning on STI-Bench Static Source: [Static Spatial Reasoning on STI-Bench Static]() Collection index: [llms.txt]() Data updated: 2026-06-11T10:26:31.728Z Evaluation of model performance on the STI-Bench Static dataset, specifically focusing on Static Spatial Reasoning capabilities. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Static Spatial Reasoning | | Dataset (including any stated split) | STI-Bench Static | | Metric | Avg. Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Avg. Score](): Higher is better; unit: PERCENT. - [Dimensional Measurement Score](): Higher is better; unit: PERCENT. - [Spatial Relation Score](): Higher is better; unit: PERCENT. - [3D Video Grounding Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Avg. Score | Result date | Report paper | | --- | --- | --- | --- | | Gemini-2.5-Pro | 37.1 | Not recorded | 6a2a4136d33dfb23e783943e | | Claude-3.7-Sonnet | 37 | Not recorded | 6a2a4136d33dfb23e783943e | | Gemini-2.0-Flash | 36.9 | Not recorded | 6a2a4136d33dfb23e783943e | | ReRe | 34.8 | Not recorded | 6a2a4136d33dfb23e783943e | | ReRe | 34.4 | Not recorded | 6a2a4136d33dfb23e783943e | | INTERNVL2.5-8B | 32.1 | Not recorded | 6a2a4136d33dfb23e783943e | | GPT-4o | 31 | Not recorded | 6a2a4136d33dfb23e783943e | | ReRe | 30.9 | Not recorded | 6a2a4136d33dfb23e783943e | | ReRe | 30.6 | Not recorded | 6a2a4136d33dfb23e783943e | | INTERNVL2.5-4B | 30.5 | Not recorded | 6a2a4136d33dfb23e783943e | | ReRe | 30.2 | Not recorded | 6a2a4136d33dfb23e783943e | | QWEN3-VL-4B | 29.7 | Not recorded | 6a2a4136d33dfb23e783943e | | QWEN3-VL-8B | 27.9 | Not recorded | 6a2a4136d33dfb23e783943e | | ReRe | 27.8 | Not recorded | 6a2a4136d33dfb23e783943e | | ReRe | 26.7 | Not recorded | 6a2a4136d33dfb23e783943e | | INTERNVL3-8B | 24.5 | Not recorded | 6a2a4136d33dfb23e783943e | | INTERNVL3-2B | 22.6 | Not recorded | 6a2a4136d33dfb23e783943e | | QWEN3-VL-2B | 22.2 | Not recorded | 6a2a4136d33dfb23e783943e | ### Gemini-2.5-Pro Avg. Score: 37.1. Result ID: 6a2a8c84fbc373592c285974. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Proprietary Model (API)"}. This record does not assert independent reproduction. ### Claude-3.7-Sonnet Avg. Score: 37. Result ID: 6a2a8c84fbc373592c285972. [Reporting paper]() Recorded evaluation configuration: {"Type":"Proprietary Model (API)"}. This record does not assert independent reproduction. ### Gemini-2.0-Flash Avg. Score: 36.9. Result ID: 6a2a8c84fbc373592c285973. [Reporting paper]() Recorded evaluation configuration: {"Type":"Proprietary Model (API)"}. This record does not assert independent reproduction. ### ReRe Avg. Score: 34.8. Result ID: 6a2a8c84fbc373592c28597e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"INTERNVL2.5-8B"}. This record does not assert independent reproduction. ### ReRe Avg. Score: 34.4. Result ID: 6a2a8c84fbc373592c285978. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"QWEN3-VL-4B"}. This record does not assert independent reproduction. ### INTERNVL2.5-8B Avg. Score: 32.1. Result ID: 6a2a8c84fbc373592c28597d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Framework":"Baseline"}. This record does not assert independent reproduction. ### GPT-4o Avg. Score: 31. Result ID: 6a2a8c84fbc373592c285971. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Proprietary Model (API)"}. This record does not assert independent reproduction. ### ReRe Avg. Score: 30.9. Result ID: 6a2a8c84fbc373592c28597a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"QWEN3-VL-8B"}. This record does not assert independent reproduction. ### ReRe Avg. Score: 30.6. Result ID: 6a2a8c84fbc373592c28597c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"INTERNVL2.5-4B"}. This record does not assert independent reproduction. ### INTERNVL2.5-4B Avg. Score: 30.5. Result ID: 6a2a8c84fbc373592c28597b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Framework":"Baseline"}. This record does not assert independent reproduction. ### ReRe Avg. Score: 30.2. Result ID: 6a2a8c84fbc373592c285976. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"QWEN3-VL-2B"}. This record does not assert independent reproduction. ### QWEN3-VL-4B Avg. Score: 29.7. Result ID: 6a2a8c84fbc373592c285977. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"Baseline"}. This record does not assert independent reproduction. ### QWEN3-VL-8B Avg. Score: 27.9. Result ID: 6a2a8c84fbc373592c285979. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"Baseline"}. This record does not assert independent reproduction. ### ReRe Avg. Score: 27.8. Result ID: 6a2a8c84fbc373592c285982. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"INTERNVL3-8B"}. This record does not assert independent reproduction. ### ReRe Avg. Score: 26.7. Result ID: 6a2a8c84fbc373592c285980. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"INTERNVL3-2B"}. This record does not assert independent reproduction. ### INTERNVL3-8B Avg. Score: 24.5. Result ID: 6a2a8c84fbc373592c285981. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"Baseline"}. This record does not assert independent reproduction. ### INTERNVL3-2B Avg. Score: 22.6. Result ID: 6a2a8c84fbc373592c28597f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"Baseline"}. This record does not assert independent reproduction. ### QWEN3-VL-2B Avg. Score: 22.2. Result ID: 6a2a8c84fbc373592c285975. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"Baseline"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.