# Visual QA on VizWiz

Source: [Visual QA on VizWiz](<https://www.sota2.com/research/sota/visual-qa-on-vizwiz>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-17T06:33:23.217Z

Evaluation of Visual Question Answering performance on the VizWiz dataset, specifically reporting Kendall's Tau correlation.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Visual QA |
| Dataset (including any stated split) | VizWiz |
| Metric | Kendall's Tau |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 5 of 5 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Kendall's Tau](<https://www.sota2.com/research/sota/visual-qa-on-vizwiz.md?metric=Kendall%27s%20Tau>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Kendall's Tau | Result date | Report paper |
| --- | --- | --- | --- |
| Mordal | 0.882 | Not recorded | 68fa76c81e209131cea6f053 |
| EMMS | 0.657 | Not recorded | 68fa76c81e209131cea6f053 |
| NLEEP | 0.502 | Not recorded | 68fa76c81e209131cea6f053 |
| LEEP | 0.351 | Not recorded | 68fa76c81e209131cea6f053 |
| LogME | 0.236 | Not recorded | 68fa76c81e209131cea6f053 |

### Mordal

Kendall's Tau: 0.882. Result ID: 6a323f9afbc373592c2f1012.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76c81e209131cea6f053.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76c81e209131cea6f053.md>)

Recorded evaluation configuration: {"Time consumption":"Same"}. This record does not assert independent reproduction.

### EMMS

Kendall's Tau: 0.657. Result ID: 6a323f9afbc373592c2f100e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76c81e209131cea6f053.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70441e209131cea4a036.md>)

Recorded evaluation configuration: {"Time consumption":"Same"}. This record does not assert independent reproduction.

### NLEEP

Kendall's Tau: 0.502. Result ID: 6a323f9afbc373592c2f1011.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76c81e209131cea6f053.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d4c1e209131cea38e8c.md>)

[Implementation](<https://github.com/google-research/google-research/tree/master/rank_ckpt>)

Recorded evaluation configuration: {"Time consumption":"Same"}. This record does not assert independent reproduction.

### LEEP

Kendall's Tau: 0.351. Result ID: 6a323f9afbc373592c2f1010.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76c81e209131cea6f053.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa682f1e209131cea1a9fc.md>)

Recorded evaluation configuration: {"Time consumption":"Same"}. This record does not assert independent reproduction.

### LogME

Kendall's Tau: 0.236. Result ID: 6a323f9afbc373592c2f100f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76c81e209131cea6f053.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a381e209131cea26a62.md>)

[Implementation](<https://github.com/thuml/LogME>)

Recorded evaluation configuration: {"Time consumption":"Same"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
