# Visual Question Answering on RSWK mini

Source: [Visual Question Answering on RSWK mini](<https://www.sota2.com/research/sota/visual-question-answering-on-rswk-mini>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:37:15.318Z

Evaluation of model performance on the RSWK mini dataset for Visual Question Answering, reporting standard generation metrics like BLEU, METEOR, ROUGE, and CIDEr.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Visual Question Answering |
| Dataset (including any stated split) | RSWK mini |
| Metric | BLEU-1 |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 7 of 7 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [BLEU-1](<https://www.sota2.com/research/sota/visual-question-answering-on-rswk-mini.md?metric=BLEU-1>): Higher is better; unit: SCALAR.

- [BLEU-2](<https://www.sota2.com/research/sota/visual-question-answering-on-rswk-mini.md?metric=BLEU-2>): Higher is better; unit: SCALAR.

- [BLEU-3](<https://www.sota2.com/research/sota/visual-question-answering-on-rswk-mini.md?metric=BLEU-3>): Higher is better; unit: SCALAR.

- [BLEU-4](<https://www.sota2.com/research/sota/visual-question-answering-on-rswk-mini.md?metric=BLEU-4>): Higher is better; unit: SCALAR.

- [METEOR](<https://www.sota2.com/research/sota/visual-question-answering-on-rswk-mini.md?metric=METEOR>): Higher is better; unit: SCALAR.

- [ROUGE-L](<https://www.sota2.com/research/sota/visual-question-answering-on-rswk-mini.md?metric=ROUGE-L>): Higher is better; unit: SCALAR.

- [CIDEr](<https://www.sota2.com/research/sota/visual-question-answering-on-rswk-mini.md?metric=CIDEr>): Higher is better; unit: SCALAR.

## Recorded results

| Method | BLEU-1 | Result date | Report paper |
| --- | --- | --- | --- |
| RS-RAG | 0.254 | Not recorded | 68fa77e71e209131cea75e9c |
| RSGPT | 0.209 | Not recorded | 68fa77e71e209131cea75e9c |
| Geochat | 0.207 | Not recorded | 68fa77e71e209131cea75e9c |
| Qwen2.5-VL | 0.102 | Not recorded | 68fa77e71e209131cea75e9c |
| Llama3.2-Vision | 0.102 | Not recorded | 68fa77e71e209131cea75e9c |
| InternVL2.5 | 0.095 | Not recorded | 68fa77e71e209131cea75e9c |
| Janus-Pro | 0.094 | Not recorded | 68fa77e71e209131cea75e9c |

### RS-RAG

BLEU-1: 0.254. Result ID: 699a3d235698665ec4c3b477.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77e71e209131cea75e9c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77e71e209131cea75e9c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RSGPT

BLEU-1: 0.209. Result ID: 699a3d235698665ec4c3b475.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77e71e209131cea75e9c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70221e209131cea4949b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Geochat

BLEU-1: 0.207. Result ID: 699a3d235698665ec4c3b476.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77e71e209131cea75e9c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa714c1e209131cea50865.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Qwen2.5-VL

BLEU-1: 0.102. Result ID: 699a3d235698665ec4c3b473.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77e71e209131cea75e9c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Llama3.2-Vision

BLEU-1: 0.102. Result ID: 699a3d235698665ec4c3b474.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77e71e209131cea75e9c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### InternVL2.5

BLEU-1: 0.095. Result ID: 699a3d235698665ec4c3b471.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77e71e209131cea75e9c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71de1e209131cea5370d.md>)

[Implementation](<https://github.com/OpenGVLab/InternVL>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Janus-Pro

BLEU-1: 0.094. Result ID: 699a3d235698665ec4c3b472.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77e71e209131cea75e9c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76cc1e209131cea6f20a.md>)

[Implementation](<https://github.com/deepseek-ai/Janus>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
