# Visual Grounded Reasoning on TreeBench

Source: [Visual Grounded Reasoning on TreeBench](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-16T09:34:43.390Z

Evaluation of model performance on the TreeBench dataset focusing on Visual Grounded Reasoning, including detailed sub-scores for attributes, spatial context, ordering, and OCR.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Visual Grounded Reasoning |
| Dataset (including any stated split) | TreeBench |
| Metric | Overall Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 179 of 179 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Overall Score](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Overall%20Score>): Higher is better; unit: PERCENT.

- [mIoU](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=mIoU>): Higher is better; unit: PERCENT.

- [Attributes Score](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Attributes%20Score>): Higher is better; unit: PERCENT.

- [Material Score](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Material%20Score>): Higher is better; unit: PERCENT.

- [Physical State Score](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Physical%20State%20Score>): Higher is better; unit: PERCENT.

- [Object Retrieval Score](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Object%20Retrieval%20Score>): Higher is better; unit: PERCENT.

- [OCR Accuracy](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=OCR%20Accuracy>): Higher is better; unit: PERCENT.

- [Perspective Transformation Score](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Perspective%20Transformation%20Score>): Higher is better; unit: PERCENT.

- [Ordering Score](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Ordering%20Score>): Higher is better; unit: PERCENT.

- [Connectivity & Occlusion Score](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Connectivity%20%26%20Occlusion%20Score>): Higher is better; unit: PERCENT.

- [Spatial Context Score](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Spatial%20Context%20Score>): Higher is better; unit: PERCENT.

- [Comparison Score](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Comparison%20Score>): Higher is better; unit: PERCENT.

- [Perc. Score](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Perc.%20Score>): Higher is better; unit: PERCENT.

- [Reasoning Score](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Reasoning%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Overall Score | Result date | Report paper |
| --- | --- | --- | --- |
| o3-0416 | 54.8 | Not recorded | 692d210bd6b0dd334293164d |
| GPT-o3-0416 | 54.8 | Not recorded | 69a90e122d603e6de3e40870 |
| o3-0416 | 54.8 | Not recorded | 68fa79fd1e209131cea807a5 |
| o3-0416 | 54.8 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| o3 | 54.8 | Not recorded | 69a519822d603e6de3e3c99b |
| Gemini-2.5-Pro-0605 | 54.1 | Not recorded | 692d210bd6b0dd334293164d |
| Gemini-2.5-Pro-0605 | 54.1 | Not recorded | 69a90e122d603e6de3e40870 |
| Gemini-2.5-Pro-0605 | 54.1 | Not recorded | 68fa79fd1e209131cea807a5 |
| Gemini-2.5-Pro-0605 | 54.1 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| Gemini-2.5-Pro | 54.1 | Not recorded | 69a519822d603e6de3e3c99b |
| TTSP | 51.8 | Not recorded | 69ddca677d0172140ec79e6b |
| Nemotron 3 Nano Omni | 51.6 | Not recorded | 69f1907355a3c32af89fb98b |
| GRiP | 51.3 | Not recorded | 692d210bd6b0dd334293164d |
| InternVL3-78B | 50.9 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| TTSP | 50.9 | Not recorded | 69ddca677d0172140ec79e6b |
| TreeVGR-7B | 50.4 | Not recorded | 692d210bd6b0dd334293164d |
| TreeVGR-7B | 50.4 | Not recorded | 68fa79fd1e209131cea807a5 |
| TreeVGR-7B | 50.4 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| RTWI | 50.1 | Not recorded | 69ddca677d0172140ec79e6b |
| Qwen2.5-VL-72B | 49.9 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| Deepconf | 49.9 | Not recorded | 69ddca677d0172140ec79e6b |
| TreeVGR | 49.1 | Not recorded | 68fa7ba91e209131cea89bb1 |
| RTWI | 49.1 | Not recorded | 69ddca677d0172140ec79e6b |
| SC | 49.1 | Not recorded | 69ddca677d0172140ec79e6b |
| TRT | 48.9 | Not recorded | 69ddca677d0172140ec79e6b |
| Qwen2.5-VL-32B | 48.6 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| Self-Ref. | 48.6 | Not recorded | 69ddca677d0172140ec79e6b |
| InternVL3-38B | 48.4 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| TreeVGR | 48.2 | Not recorded | 68fa7ba91e209131cea89bb1 |
| Deepconf | 48.2 | Not recorded | 69ddca677d0172140ec79e6b |
| CISC | 48.2 | Not recorded | 69ddca677d0172140ec79e6b |
| Self-Cer. | 48.2 | Not recorded | 69ddca677d0172140ec79e6b |
| Qwen2.5-VL-7B | 47.9 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| SC | 47.7 | Not recorded | 69ddca677d0172140ec79e6b |
| Self-Ref. | 47.7 | Not recorded | 69ddca677d0172140ec79e6b |
| CISC | 47.2 | Not recorded | 69ddca677d0172140ec79e6b |
| TRT | 47.2 | Not recorded | 69ddca677d0172140ec79e6b |
| Self-Cer. | 47.2 | Not recorded | 69ddca677d0172140ec79e6b |
| GPT-4o-1120 | 46.9 | Not recorded | 692d210bd6b0dd334293164d |
| GPT-4o-1120 | 46.9 | Not recorded | 69a90e122d603e6de3e40870 |
| GPT-4o-1120 | 46.9 | Not recorded | 68fa79fd1e209131cea807a5 |
| GPT-4o-1120 | 46.9 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| LLaVA-OneVision-72B | 46.9 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| GPT-4o | 46.9 | Not recorded | 69a519822d603e6de3e3c99b |
| GPT-4o | 46.9 | Not recorded | 69ddca677d0172140ec79e6b |
| GPT-4o | 46.9 | Not recorded | 6a0bef1adbc836b87d82cb4a |
| GPT-4o | 46.9 | Not recorded | 6a30d8ffd33dfb23e783d12e |
| InternVL3-78B | 46.4 | Not recorded | 692d210bd6b0dd334293164d |
| InternVL3-78B | 46.4 | Not recorded | 69a90e122d603e6de3e40870 |
| InternVL3-78B | 46.4 | Not recorded | 68fa79fd1e209131cea807a5 |
| InternVL3-78B | 46.4 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| Base | 46.4 | Not recorded | 69ddca677d0172140ec79e6b |
| Gemini-2.5-Flash-0520 | 45.9 | Not recorded | 692d210bd6b0dd334293164d |
| Gemini-2.5-Flash-0520 | 45.9 | Not recorded | 69a90e122d603e6de3e40870 |
| Gemini-2.5-Flash-0520 | 45.9 | Not recorded | 68fa79fd1e209131cea807a5 |
| Gemini-2.5-Flash-0520 | 45.9 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| Gemini-2.5-Flash | 45.9 | Not recorded | 69a519822d603e6de3e3c99b |
| InternVL3-8B | 45.2 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| Base | 45.2 | Not recorded | 69ddca677d0172140ec79e6b |
| HART-7B | 43.7 | Not recorded | 69a519822d603e6de3e3c99b |
| Nemotron 3 Nano Omni | 43.7 | Not recorded | 69f1907355a3c32af89fb98b |
| LLaVA-OneVision-7B | 43.5 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| LazyMCoT | 43.5 | Not recorded | 6a30d8ffd33dfb23e783d12e |
| ERGO | 43.2 | Not recorded | 68fa7ba91e209131cea89bb1 |
| Base | 43 | Not recorded | 6a30d8ffd33dfb23e783d12e |
| Qwen2.5-VL-32B | 42.5 | Not recorded | 692d210bd6b0dd334293164d |
| Qwen2.5-VL-32B | 42.5 | Not recorded | 69a90e122d603e6de3e40870 |
| DeepScan | 42.5 | Not recorded | 69a90e122d603e6de3e40870 |
| Qwen2.5-VL-32B | 42.5 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| Qwen2.5-VL-32B | 42.5 | Not recorded | 69a519822d603e6de3e3c99b |
| Nemotron Nano V2 VL | 42.5 | Not recorded | 69f1907355a3c32af89fb98b |
| PixelReasoner | 42.3 | Not recorded | 68fa7ba91e209131cea89bb1 |
| Qwen2.5-VL-72B | 42.2 | Not recorded | 692d210bd6b0dd334293164d |
| Qwen2.5-VL-72B | 42.2 | Not recorded | 69a90e122d603e6de3e40870 |
| Qwen2.5-VL-72B | 42.2 | Not recorded | 68fa79fd1e209131cea807a5 |
| Qwen2.5-VL-72B | 42.2 | Not recorded | 699fd36a2d603e6de3e3bda3 |
| Qwen2.5-VL-72B | 42.2 | Not recorded | 69a519822d603e6de3e3c99b |
| InternVL3-38B | 42 | Not recorded | 692d210bd6b0dd334293164d |
| InternVL3-38B | 42 | Not recorded | 69a90e122d603e6de3e40870 |
| InternVL3-38B | 42 | Not recorded | 699fd36a2d603e6de3e3bda3 |

### o3-0416

Overall Score: 54.8. Result ID: 6995e5b23badfaffe6edb45c.

[Reporting paper](<https://www.sota2.com/research/paper/692d210bd6b0dd334293164d.md>)

Recorded evaluation configuration: {"Model Category":"Private Model"}. This record does not assert independent reproduction.

### GPT-o3-0416

Overall Score: 54.8. Result ID: 69a944ed6dbb7075b952db4f.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e122d603e6de3e40870.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### o3-0416

Overall Score: 54.8. Result ID: 69aa7d4c6dbb7075b953bf57.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79fd1e209131cea807a5.md>)

Recorded evaluation configuration: {"Model Type":"Private Models"}. This record does not assert independent reproduction.

### o3-0416

Overall Score: 54.8. Result ID: 69afc9bf6dbb7075b957cb55.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### o3

Overall Score: 54.8. Result ID: 69afed506dbb7075b958d76d.

[Reporting paper](<https://www.sota2.com/research/paper/69a519822d603e6de3e3c99b.md>)

Recorded evaluation configuration: {"Parameters":"—"}. This record does not assert independent reproduction.

### Gemini-2.5-Pro-0605

Overall Score: 54.1. Result ID: 6995e5b23badfaffe6edb45b.

[Reporting paper](<https://www.sota2.com/research/paper/692d210bd6b0dd334293164d.md>)

Recorded evaluation configuration: {"Model Category":"Private Model"}. This record does not assert independent reproduction.

### Gemini-2.5-Pro-0605

Overall Score: 54.1. Result ID: 69a944ed6dbb7075b952db4e.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e122d603e6de3e40870.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Gemini-2.5-Pro-0605

Overall Score: 54.1. Result ID: 69aa7d4c6dbb7075b953bf56.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79fd1e209131cea807a5.md>)

Recorded evaluation configuration: {"Model Type":"Private Models"}. This record does not assert independent reproduction.

### Gemini-2.5-Pro-0605

Overall Score: 54.1. Result ID: 69afc9bf6dbb7075b957cb54.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Gemini-2.5-Pro

Overall Score: 54.1. Result ID: 69afed506dbb7075b958d76c.

[Reporting paper](<https://www.sota2.com/research/paper/69a519822d603e6de3e3c99b.md>)

Recorded evaluation configuration: {"Parameters":"—"}. This record does not assert independent reproduction.

### TTSP

Overall Score: 51.8. Result ID: 69de209847f34ce924c67e91.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B-Instruct"}. This record does not assert independent reproduction.

### Nemotron 3 Nano Omni

Overall Score: 51.6. Result ID: 69f1ae5847f34ce924d7aee4.

[Reporting paper](<https://www.sota2.com/research/paper/69f1907355a3c32af89fb98b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69f1907355a3c32af89fb98b.md>)

Recorded evaluation configuration: {"Open-Source":"true","Size":"30B-A3B","Reasoning":"on"}. This record does not assert independent reproduction.

### GRiP

Overall Score: 51.3. Result ID: 6995e5b23badfaffe6edb469.

[Reporting paper](<https://www.sota2.com/research/paper/692d210bd6b0dd334293164d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/692d210bd6b0dd334293164d.md>)

Recorded evaluation configuration: {"Model Category":"Open-source Visual Grounded Reasoning Model"}. This record does not assert independent reproduction.

### InternVL3-78B

Overall Score: 50.9. Result ID: 69afc9bf6dbb7075b957cb65.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: {"ECRD":"true"}. This record does not assert independent reproduction.

### TTSP

Overall Score: 50.9. Result ID: 69de209847f34ce924c67e88.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### TreeVGR-7B

Overall Score: 50.4. Result ID: 6995e5b23badfaffe6edb468.

[Reporting paper](<https://www.sota2.com/research/paper/692d210bd6b0dd334293164d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79fd1e209131cea807a5.md>)

Recorded evaluation configuration: {"Model Category":"Open-source Visual Grounded Reasoning Model","Parameters":"7B"}. This record does not assert independent reproduction.

### TreeVGR-7B

Overall Score: 50.4. Result ID: 69aa7d4c6dbb7075b953bf60.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79fd1e209131cea807a5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79fd1e209131cea807a5.md>)

Recorded evaluation configuration: {"Model Type":"Open-source Visual Grounded Reasoning Models","Parameters":"7B"}. This record does not assert independent reproduction.

### TreeVGR-7B

Overall Score: 50.4. Result ID: 69afc9bf6dbb7075b957cb68.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79fd1e209131cea807a5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RTWI

Overall Score: 50.1. Result ID: 69de209847f34ce924c67e90.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6992a4749ebc499c97406be0.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B-Instruct"}. This record does not assert independent reproduction.

### Qwen2.5-VL-72B

Overall Score: 49.9. Result ID: 69afc9bf6dbb7075b957cb5b.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: {"ECRD":"true"}. This record does not assert independent reproduction.

### Deepconf

Overall Score: 49.9. Result ID: 69de209847f34ce924c67e8f.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ad41e209131cea855e8.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B-Instruct"}. This record does not assert independent reproduction.

### TreeVGR

Overall Score: 49.1. Result ID: 69ba57d947f34ce924a3e8fe.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba91e209131cea89bb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79fd1e209131cea807a5.md>)

Recorded evaluation configuration: {"Pixel Constraint":"640x28x28","Post-training Category":"Non-efficiency-oriented Post Training Methods","Inference Pipeline":"inference with original pipeline"}. This record does not assert independent reproduction.

### RTWI

Overall Score: 49.1. Result ID: 69de209847f34ce924c67e87.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6992a4749ebc499c97406be0.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### SC

Overall Score: 49.1. Result ID: 69de209847f34ce924c67e8a.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb61e209131cea41b33.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B-Instruct"}. This record does not assert independent reproduction.

### TRT

Overall Score: 48.9. Result ID: 69de209847f34ce924c67e8c.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6982d2e7a8b01e76cc8e98ce.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B-Instruct"}. This record does not assert independent reproduction.

### Qwen2.5-VL-32B

Overall Score: 48.6. Result ID: 69afc9bf6dbb7075b957cb59.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: {"ECRD":"true"}. This record does not assert independent reproduction.

### Self-Ref.

Overall Score: 48.6. Result ID: 69de209847f34ce924c67e8d.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f7f1e209131cea45fc4.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B-Instruct"}. This record does not assert independent reproduction.

### InternVL3-38B

Overall Score: 48.4. Result ID: 69afc9bf6dbb7075b957cb63.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: {"ECRD":"true"}. This record does not assert independent reproduction.

### TreeVGR

Overall Score: 48.2. Result ID: 69ba57d947f34ce924a3e8f6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba91e209131cea89bb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79fd1e209131cea807a5.md>)

Recorded evaluation configuration: {"Pixel Constraint":"1280x28x28","Post-training Category":"Non-efficiency-oriented Post Training Methods","Inference Pipeline":"inference with original pipeline"}. This record does not assert independent reproduction.

### Deepconf

Overall Score: 48.2. Result ID: 69de209847f34ce924c67e86.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ad41e209131cea855e8.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### CISC

Overall Score: 48.2. Result ID: 69de209847f34ce924c67e8b.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba01e209131cea89713.md>)

[Implementation](<https://github.com/google-research/google-research/tree/master/cisc>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B-Instruct"}. This record does not assert independent reproduction.

### Self-Cer.

Overall Score: 48.2. Result ID: 69de209847f34ce924c67e8e.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77291e209131cea717ab.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B-Instruct"}. This record does not assert independent reproduction.

### Qwen2.5-VL-7B

Overall Score: 47.9. Result ID: 69afc9bf6dbb7075b957cb57.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: {"ECRD":"true"}. This record does not assert independent reproduction.

### SC

Overall Score: 47.7. Result ID: 69de209847f34ce924c67e81.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb61e209131cea41b33.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### Self-Ref.

Overall Score: 47.7. Result ID: 69de209847f34ce924c67e84.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f7f1e209131cea45fc4.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### CISC

Overall Score: 47.2. Result ID: 69de209847f34ce924c67e82.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba01e209131cea89713.md>)

[Implementation](<https://github.com/google-research/google-research/tree/master/cisc>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### TRT

Overall Score: 47.2. Result ID: 69de209847f34ce924c67e83.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6982d2e7a8b01e76cc8e98ce.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### Self-Cer.

Overall Score: 47.2. Result ID: 69de209847f34ce924c67e85.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77291e209131cea717ab.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### GPT-4o-1120

Overall Score: 46.9. Result ID: 6995e5b23badfaffe6edb45a.

[Reporting paper](<https://www.sota2.com/research/paper/692d210bd6b0dd334293164d.md>)

Recorded evaluation configuration: {"Model Category":"Private Model"}. This record does not assert independent reproduction.

### GPT-4o-1120

Overall Score: 46.9. Result ID: 69a944ed6dbb7075b952db4d.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e122d603e6de3e40870.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GPT-4o-1120

Overall Score: 46.9. Result ID: 69aa7d4c6dbb7075b953bf55.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79fd1e209131cea807a5.md>)

Recorded evaluation configuration: {"Model Type":"Private Models"}. This record does not assert independent reproduction.

### GPT-4o-1120

Overall Score: 46.9. Result ID: 69afc9bf6dbb7075b957cb53.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LLaVA-OneVision-72B

Overall Score: 46.9. Result ID: 69afc9bf6dbb7075b957cb5f.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: {"ECRD":"true"}. This record does not assert independent reproduction.

### GPT-4o

Overall Score: 46.9. Result ID: 69afed506dbb7075b958d76b.

[Reporting paper](<https://www.sota2.com/research/paper/69a519822d603e6de3e3c99b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75681e209131cea67a98.md>)

Recorded evaluation configuration: {"Parameters":"—"}. This record does not assert independent reproduction.

### GPT-4o

Overall Score: 46.9. Result ID: 69de209847f34ce924c67e7c.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa727a1e209131cea56a1e.md>)

[Implementation](<https://github.com/openai/evals>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GPT-4o

Overall Score: 46.9. Result ID: 6a0c64fafbc373592c042a55.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bef1adbc836b87d82cb4a.md>)

Recorded evaluation configuration: {"Visual Bandwidth Constraint (B)":"No Constrain","Reported From":"Other publications"}. This record does not assert independent reproduction.

### GPT-4o

Overall Score: 46.9. Result ID: 6a31189dfbc373592c2dccb9.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8ffd33dfb23e783d12e.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### InternVL3-78B

Overall Score: 46.4. Result ID: 6995e5b23badfaffe6edb465.

[Reporting paper](<https://www.sota2.com/research/paper/692d210bd6b0dd334293164d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76fa5.md>)

Recorded evaluation configuration: {"Model Category":"Open-source General Model","Parameters":"78B"}. This record does not assert independent reproduction.

### InternVL3-78B

Overall Score: 46.4. Result ID: 69a944ed6dbb7075b952db57.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e122d603e6de3e40870.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76fa5.md>)

Recorded evaluation configuration: {"Parameter Scale":"78B"}. This record does not assert independent reproduction.

### InternVL3-78B

Overall Score: 46.4. Result ID: 69aa7d4c6dbb7075b953bf5d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79fd1e209131cea807a5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76fa5.md>)

Recorded evaluation configuration: {"Model Type":"Open-source General Models","Parameters":"78B"}. This record does not assert independent reproduction.

### InternVL3-78B

Overall Score: 46.4. Result ID: 69afc9bf6dbb7075b957cb64.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: {"ECRD":"false"}. This record does not assert independent reproduction.

### Base

Overall Score: 46.4. Result ID: 69de209847f34ce924c67e89.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B-Instruct"}. This record does not assert independent reproduction.

### Gemini-2.5-Flash-0520

Overall Score: 45.9. Result ID: 6995e5b23badfaffe6edb459.

[Reporting paper](<https://www.sota2.com/research/paper/692d210bd6b0dd334293164d.md>)

Recorded evaluation configuration: {"Model Category":"Private Model"}. This record does not assert independent reproduction.

### Gemini-2.5-Flash-0520

Overall Score: 45.9. Result ID: 69a944ed6dbb7075b952db4c.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e122d603e6de3e40870.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Gemini-2.5-Flash-0520

Overall Score: 45.9. Result ID: 69aa7d4c6dbb7075b953bf54.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79fd1e209131cea807a5.md>)

Recorded evaluation configuration: {"Model Type":"Private Models"}. This record does not assert independent reproduction.

### Gemini-2.5-Flash-0520

Overall Score: 45.9. Result ID: 69afc9bf6dbb7075b957cb52.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Gemini-2.5-Flash

Overall Score: 45.9. Result ID: 69afed506dbb7075b958d76a.

[Reporting paper](<https://www.sota2.com/research/paper/69a519822d603e6de3e3c99b.md>)

Recorded evaluation configuration: {"Parameters":"—"}. This record does not assert independent reproduction.

### InternVL3-8B

Overall Score: 45.2. Result ID: 69afc9bf6dbb7075b957cb61.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: {"ECRD":"true"}. This record does not assert independent reproduction.

### Base

Overall Score: 45.2. Result ID: 69de209847f34ce924c67e80.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca677d0172140ec79e6b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### HART-7B

Overall Score: 43.7. Result ID: 69afed506dbb7075b958d765.

[Reporting paper](<https://www.sota2.com/research/paper/69a519822d603e6de3e3c99b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a519822d603e6de3e3c99b.md>)

Recorded evaluation configuration: {"Parameters":"7B"}. This record does not assert independent reproduction.

### Nemotron 3 Nano Omni

Overall Score: 43.7. Result ID: 69f1ae5847f34ce924d7aee3.

[Reporting paper](<https://www.sota2.com/research/paper/69f1907355a3c32af89fb98b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69f1907355a3c32af89fb98b.md>)

Recorded evaluation configuration: {"Open-Source":"true","Size":"30B-A3B","Reasoning":"off"}. This record does not assert independent reproduction.

### LLaVA-OneVision-7B

Overall Score: 43.5. Result ID: 69afc9bf6dbb7075b957cb5d.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: {"ECRD":"true"}. This record does not assert independent reproduction.

### LazyMCoT

Overall Score: 43.5. Result ID: 6a31189dfbc373592c2dccc1.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8ffd33dfb23e783d12e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a30d8ffd33dfb23e783d12e.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B-Instruct"}. This record does not assert independent reproduction.

### ERGO

Overall Score: 43.2. Result ID: 69ba57d947f34ce924a3e902.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba91e209131cea89bb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba91e209131cea89bb1.md>)

Recorded evaluation configuration: {"Pixel Constraint":"640x28x28","Post-training Category":"Efficiency-oriented Post Training Methods"}. This record does not assert independent reproduction.

### Base

Overall Score: 43. Result ID: 6a31189dfbc373592c2dccbf.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8ffd33dfb23e783d12e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B-Instruct"}. This record does not assert independent reproduction.

### Qwen2.5-VL-32B

Overall Score: 42.5. Result ID: 6995e5b23badfaffe6edb461.

[Reporting paper](<https://www.sota2.com/research/paper/692d210bd6b0dd334293164d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Model Category":"Open-source General Model","Parameters":"32B"}. This record does not assert independent reproduction.

### Qwen2.5-VL-32B

Overall Score: 42.5. Result ID: 69a944ed6dbb7075b952db53.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e122d603e6de3e40870.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Parameter Scale":"32B"}. This record does not assert independent reproduction.

### DeepScan

Overall Score: 42.5. Result ID: 69a944ed6dbb7075b952db5d.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e122d603e6de3e40870.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e122d603e6de3e40870.md>)

Recorded evaluation configuration: {"RL-based":"false","Backbone":"Qwen2.5-VL-7B"}. This record does not assert independent reproduction.

### Qwen2.5-VL-32B

Overall Score: 42.5. Result ID: 69afc9bf6dbb7075b957cb58.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: {"ECRD":"false"}. This record does not assert independent reproduction.

### Qwen2.5-VL-32B

Overall Score: 42.5. Result ID: 69afed506dbb7075b958d766.

[Reporting paper](<https://www.sota2.com/research/paper/69a519822d603e6de3e3c99b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Parameters":"32B"}. This record does not assert independent reproduction.

### Nemotron Nano V2 VL

Overall Score: 42.5. Result ID: 69f1ae5847f34ce924d7aee6.

[Reporting paper](<https://www.sota2.com/research/paper/69f1907355a3c32af89fb98b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/690d7d0b2828b7cc6937ce26.md>)

Recorded evaluation configuration: {"Open-Source":"true","Size":"12B","Reasoning":"on"}. This record does not assert independent reproduction.

### PixelReasoner

Overall Score: 42.3. Result ID: 69ba57d947f34ce924a3e8fc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba91e209131cea89bb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78c71e209131cea7a774.md>)

Recorded evaluation configuration: {"Pixel Constraint":"640x28x28","Post-training Category":"Non-efficiency-oriented Post Training Methods"}. This record does not assert independent reproduction.

### Qwen2.5-VL-72B

Overall Score: 42.2. Result ID: 6995e5b23badfaffe6edb462.

[Reporting paper](<https://www.sota2.com/research/paper/692d210bd6b0dd334293164d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Model Category":"Open-source General Model","Parameters":"72B"}. This record does not assert independent reproduction.

### Qwen2.5-VL-72B

Overall Score: 42.2. Result ID: 69a944ed6dbb7075b952db54.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e122d603e6de3e40870.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Parameter Scale":"72B"}. This record does not assert independent reproduction.

### Qwen2.5-VL-72B

Overall Score: 42.2. Result ID: 69aa7d4c6dbb7075b953bf5b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79fd1e209131cea807a5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Model Type":"Open-source General Models","Parameters":"72B"}. This record does not assert independent reproduction.

### Qwen2.5-VL-72B

Overall Score: 42.2. Result ID: 69afc9bf6dbb7075b957cb5a.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: {"ECRD":"false"}. This record does not assert independent reproduction.

### Qwen2.5-VL-72B

Overall Score: 42.2. Result ID: 69afed506dbb7075b958d768.

[Reporting paper](<https://www.sota2.com/research/paper/69a519822d603e6de3e3c99b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Parameters":"72B"}. This record does not assert independent reproduction.

### InternVL3-38B

Overall Score: 42. Result ID: 6995e5b23badfaffe6edb464.

[Reporting paper](<https://www.sota2.com/research/paper/692d210bd6b0dd334293164d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76fa5.md>)

Recorded evaluation configuration: {"Model Category":"Open-source General Model","Parameters":"38B"}. This record does not assert independent reproduction.

### InternVL3-38B

Overall Score: 42. Result ID: 69a944ed6dbb7075b952db56.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e122d603e6de3e40870.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76fa5.md>)

Recorded evaluation configuration: {"Parameter Scale":"38B"}. This record does not assert independent reproduction.

### InternVL3-38B

Overall Score: 42. Result ID: 69afc9bf6dbb7075b957cb62.

[Reporting paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699fd36a2d603e6de3e3bda3.md>)

Recorded evaluation configuration: {"ECRD":"false"}. This record does not assert independent reproduction.

Page 1 of 3. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/sota/visual-grounded-reasoning-on-treebench.md?metric=Overall%20Score&page=2>): Follow this link to discover more pages.
