# Hallucination on MME-RealWorld EN

Source: [Hallucination on MME-RealWorld EN](<https://www.sota2.com/research/sota/hallucination-on-mme-realworld-en>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-16T10:22:48.118Z

Evaluation of model hallucination performance specifically on the English subset of the MME RealWorld dataset, reporting a general score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Hallucination |
| Dataset (including any stated split) | MME-RealWorld EN |
| Metric | Hallucination Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Hallucination Score](<https://www.sota2.com/research/sota/hallucination-on-mme-realworld-en.md?metric=Hallucination%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Hallucination Score | Result date | Report paper |
| --- | --- | --- | --- |
| Gemini-3-Flash | 74.9 | Not recorded | 6a30d8e3d33dfb23e783d014 |
| GPT-5.1 | 64 | Not recorded | 6a30d8e3d33dfb23e783d014 |
| Qwen2.5-VL + LOCUS | 62.7 | Not recorded | 6a30d8e3d33dfb23e783d014 |
| Qwen3-VL + LOCUS | 62 | Not recorded | 6a30d8e3d33dfb23e783d014 |
| Qwen3-VL | 60 | Not recorded | 6a30d8e3d33dfb23e783d014 |
| Qwen2.5-VL | 58.8 | Not recorded | 6a30d8e3d33dfb23e783d014 |
| MiMo-VL + LOCUS | 57.1 | Not recorded | 6a30d8e3d33dfb23e783d014 |
| MiMo-VL | 54.4 | Not recorded | 6a30d8e3d33dfb23e783d014 |

### Gemini-3-Flash

Hallucination Score: 74.9. Result ID: 6a3123e4fbc373592c2e2f7e.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8e3d33dfb23e783d014.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GPT-5.1

Hallucination Score: 64. Result ID: 6a3123e4fbc373592c2e2f7d.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8e3d33dfb23e783d014.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Qwen2.5-VL + LOCUS

Hallucination Score: 62.7. Result ID: 6a3123e4fbc373592c2e2f80.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8e3d33dfb23e783d014.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a30d8e3d33dfb23e783d014.md>)

Recorded evaluation configuration: {"Size":"7B"}. This record does not assert independent reproduction.

### Qwen3-VL + LOCUS

Hallucination Score: 62. Result ID: 6a3123e4fbc373592c2e2f82.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8e3d33dfb23e783d014.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a30d8e3d33dfb23e783d014.md>)

Recorded evaluation configuration: {"Size":"4B"}. This record does not assert independent reproduction.

### Qwen3-VL

Hallucination Score: 60. Result ID: 6a3123e4fbc373592c2e2f81.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8e3d33dfb23e783d014.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"Size":"4B"}. This record does not assert independent reproduction.

### Qwen2.5-VL

Hallucination Score: 58.8. Result ID: 6a3123e4fbc373592c2e2f7f.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8e3d33dfb23e783d014.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Size":"7B"}. This record does not assert independent reproduction.

### MiMo-VL + LOCUS

Hallucination Score: 57.1. Result ID: 6a3123e4fbc373592c2e2f84.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8e3d33dfb23e783d014.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a30d8e3d33dfb23e783d014.md>)

Recorded evaluation configuration: {"Size":"7B"}. This record does not assert independent reproduction.

### MiMo-VL

Hallucination Score: 54.4. Result ID: 6a3123e4fbc373592c2e2f83.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8e3d33dfb23e783d014.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79121e209131cea7bfbd.md>)

Recorded evaluation configuration: {"Size":"7B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.