Image Captioning Evaluation on FOIL
99.2Accuracy (4-ref)RIGEL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RIGELReference Requirement=Reference-based2026.06 | 99.2 | 99.1 | — | |
| RIGELReference Requirement=Reference-free2026.06 | 98.7 | 98.7 | — | |
| Ref-FLEURReference Requirement=Reference-based2026.06 | 98.4 | 97.3 | — | |
| G-VEvalReference Requirement=Reference-based2026.06 | 98.4 | 97.8 | — | |
| DISCODEBackbone=InternVL, Reference Requirement=Reference-free2026.06 | 98.2 | 98.2 | — | |
| PearlReference-based=true, Backbone=ViT-B/32, Test time [hour]=0.0432025.12 | 97.2 | 96.5 | — | |
| PearlReference Requirement=Reference-based2026.06 | 97.2 | 96.5 | — | |
| Ref-HICEScoreReference Requirement=Reference-based2026.06 | 97 | 96.4 | — | |
| FLEURReference Requirement=Reference-free2026.06 | 96.8 | 96.8 | — | |
| PearlReference-based=false, Backbone=ViT-B/32, Test time [hour]=0.0432025.12 | 96.7 | 96.7 | — | |
| PearlReference Requirement=Reference-free2026.06 | 96.7 | 96.7 | — | |
| DENEBReference Requirement=Reference-based2026.06 | 96.1 | 95.1 | — | |
| PolosReference Requirement=Reference-based2026.06 | 95.4 | 93.3 | — | |
| RefPAC-SReference Requirement=Reference-based2026.06 | 94.9 | 93.7 | — | |
| BLIP2-ScoreReference Requirement=Reference-free2026.06 | 94.3 | 94.3 | — | |
| RefPAC-S++Reference Requirement=Reference-based2026.06 | 94.1 | 93.5 | — | |
| CLAIRReference Requirement=Reference-based2026.06 | 93.6 | — | — | |
| HICEScoreReference Requirement=Reference-free2026.06 | 93.1 | 93.1 | — | |
| BRIDGEReference-based=false2025.12 | 93 | 93 | — | |
| BRIDGEReference Requirement=Reference-free2026.06 | 93 | 93 | — | |
| RefCLIP-SReference Requirement=Reference-based2026.06 | 92.6 | 91 | — | |
| BERTScoreReference-based=true, Test time [hour]=0.0402025.12 | 92.1 | 88.6 | — | |
| SPARCSReference-based=true, Test time [hour]=< 0.012025.12 | 92.1 | 86 | — | |
| BERTScoreReference Requirement=Reference-based2026.06 | 92.1 | 88.6 | — | |
| BARTScoreReference-based=true, Test time [hour]=0.682025.12 | 91.1 | 85.3 | — | |
| CIDErReference Requirement=Reference-based2026.06 | 90.6 | 82.5 | — | |
| PAC-S++Reference Requirement=Reference-free2026.06 | 90.2 | 90.2 | — | |
| PAC-SReference Requirement=Reference-free2026.06 | 89.9 | 89.9 | — | |
| CLIP-SReference Requirement=Reference-free2026.06 | 87.2 | 87.2 | — | |
| SPICEReference Requirement=Reference-based2026.06 | 86.1 | 75.5 | — | |
| BLEUReference Requirement=Reference-based2026.06 | 82.6 | 66.5 | — | |
| METEORReference Requirement=Reference-based2026.06 | 82.6 | 78.8 | — | |
| ROUGEReference Requirement=Reference-based2026.06 | 79.3 | 71.7 | — | |
| FLEURReference Setting=1-ref2024.12 | — | — | 96.8 | |
| FLEURReference Setting=4-ref2024.12 | — | — | 96.8 | |
| GPT-FLEURReference Setting=1-ref2024.12 | — | — | 97 | |
| GPT-FLEURReference Setting=4-ref2024.12 | — | — | 97 | |
| HarmonicEvalReference Setting=1-ref2024.12 | — | — | 97.8 | |
| HarmonicEvalReference Setting=4-ref2024.12 | — | — | 97.8 | |
| PolosReference Setting=1-ref2024.12 | — | — | 93.3 | |
| PolosReference Setting=4-ref2024.12 | — | — | 95.4 | |
| RefFLEURReference Setting=1-ref2024.12 | — | — | 97.3 | |
| RefFLEURReference Setting=4-ref2024.12 | — | — | 98.4 |