# Image Captioning on Flickr 30k (BLEU-1 to 4, METEOR, ROUGE, CIDEr, SPICE)

Source: [Image Captioning on Flickr 30k (BLEU-1 to 4, METEOR, ROUGE, CIDEr, SPICE)](<https://www.sota2.com/research/sota/image-captioning-on-flickr-30k-bleu-1-to-4-meteor-rouge-cider-spice>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-16T06:49:01.801Z

Evaluation of Image Captioning performance on the Flickr 30k dataset, reporting standard sequence generation metrics including BLEU scores (1 through 4), METEOR, ROUGE, CIDEr, and SPICE.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Captioning |
| Dataset (including any stated split) | Flickr 30k |
| Metric | BLEU-4 |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [BLEU-4](<https://www.sota2.com/research/sota/image-captioning-on-flickr-30k-bleu-1-to-4-meteor-rouge-cider-spice.md?metric=BLEU-4>): Higher is better; unit: SCALAR.

- [BLEU-1](<https://www.sota2.com/research/sota/image-captioning-on-flickr-30k-bleu-1-to-4-meteor-rouge-cider-spice.md?metric=BLEU-1>): Higher is better; unit: SCALAR.

- [BLEU-2](<https://www.sota2.com/research/sota/image-captioning-on-flickr-30k-bleu-1-to-4-meteor-rouge-cider-spice.md?metric=BLEU-2>): Higher is better; unit: SCALAR.

- [BLEU-3](<https://www.sota2.com/research/sota/image-captioning-on-flickr-30k-bleu-1-to-4-meteor-rouge-cider-spice.md?metric=BLEU-3>): Higher is better; unit: SCALAR.

- [METEOR](<https://www.sota2.com/research/sota/image-captioning-on-flickr-30k-bleu-1-to-4-meteor-rouge-cider-spice.md?metric=METEOR>): Higher is better; unit: SCALAR.

- [ROUGE](<https://www.sota2.com/research/sota/image-captioning-on-flickr-30k-bleu-1-to-4-meteor-rouge-cider-spice.md?metric=ROUGE>): Higher is better; unit: SCALAR.

- [CIDEr](<https://www.sota2.com/research/sota/image-captioning-on-flickr-30k-bleu-1-to-4-meteor-rouge-cider-spice.md?metric=CIDEr>): Higher is better; unit: SCALAR.

- [SPICE](<https://www.sota2.com/research/sota/image-captioning-on-flickr-30k-bleu-1-to-4-meteor-rouge-cider-spice.md?metric=SPICE>): Higher is better; unit: SCALAR.

## Recorded results

| Method | BLEU-4 | Result date | Report paper |
| --- | --- | --- | --- |
| Proposed Model | 0.364 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| Scene Graph | 0.338 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| Multimodal | 0.333 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| ADA | 0.324 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| GNN-Visual | 0.322 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| GAT | 0.308 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| TopDown | 0.308 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| RFT | 0.306 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| High-Order | 0.301 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| SCST | 0.301 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| AoA | 0.297 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| TBDATN | 0.295 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| DRET | 0.288 | Not recorded | 6a30d88cd33dfb23e783cbb6 |
| TAKG | 0.265 | Not recorded | 6a30d88cd33dfb23e783cbb6 |

### Proposed Model

BLEU-4: 0.364. Result ID: 6a30f1a3fbc373592c2c88e6.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

Recorded evaluation configuration: {"Complexity":"near-linear O(nk)"}. This record does not assert independent reproduction.

### Scene Graph

BLEU-4: 0.338. Result ID: 6a30f1a3fbc373592c2c88db.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Multimodal

BLEU-4: 0.333. Result ID: 6a30f1a3fbc373592c2c88de.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c61e209131cea0c6cc.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ADA

BLEU-4: 0.324. Result ID: 6a30f1a3fbc373592c2c88e5.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GNN-Visual

BLEU-4: 0.322. Result ID: 6a30f1a3fbc373592c2c88da.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GAT

BLEU-4: 0.308. Result ID: 6a30f1a3fbc373592c2c88e0.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TopDown

BLEU-4: 0.308. Result ID: 6a30f1a3fbc373592c2c88e2.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RFT

BLEU-4: 0.306. Result ID: 6a30f1a3fbc373592c2c88e3.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### High-Order

BLEU-4: 0.301. Result ID: 6a30f1a3fbc373592c2c88dd.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SCST

BLEU-4: 0.301. Result ID: 6a30f1a3fbc373592c2c88df.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67551e209131cea1597e.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### AoA

BLEU-4: 0.297. Result ID: 6a30f1a3fbc373592c2c88dc.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66381e209131cea0ee11.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TBDATN

BLEU-4: 0.295. Result ID: 6a30f1a3fbc373592c2c88e1.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DRET

BLEU-4: 0.288. Result ID: 6a30f1a3fbc373592c2c88e4.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TAKG

BLEU-4: 0.265. Result ID: 6a30f1a3fbc373592c2c88d9.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d88cd33dfb23e783cbb6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
