# Human Correlation for Image Captioning Evaluation on EX-8K Source: [Human Correlation for Image Captioning Evaluation on EX-8K]() Collection index: [llms.txt]() Data updated: 2026-05-22T06:58:32.905Z Evaluation of Image Captioning correlation using Kendall's tau-c on the EX-8K dataset. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Human Correlation for Image Captioning Evaluation | | Dataset (including any stated split) | EX-8K | | Metric | Kendall's tau-c | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Kendall's tau-c](): Higher is better; unit: SCALAR. ## Recorded results | Method | Kendall's tau-c | Result date | Report paper | | --- | --- | --- | --- | | BEiTScore-L/14 | 60.2 | Not recorded | 6a0fe2eff984739ed6739c5e | | BEiTScore-B/32 | 59.4 | Not recorded | 6a0fe2eff984739ed6739c5e | | BEiTScore-L/14 w/o Stage 1 | 57.8 | Not recorded | 6a0fe2eff984739ed6739c5e | | BEiTScore-B/32 w/o Stage 1 | 57.6 | Not recorded | 6a0fe2eff984739ed6739c5e | | PAC-S++/ViT-L | 57.4 | Not recorded | 6a0fe2eff984739ed6739c5e | | EXPERT | 56.7 | Not recorded | 6a0fe2eff984739ed6739c5e | | PAC-S/ViT-L | 55.7 | Not recorded | 6a0fe2eff984739ed6739c5e | | CLIP-S/ViT-L | 54.7 | Not recorded | 6a0fe2eff984739ed6739c5e | | PAC-S++/ViT-B | 54.5 | Not recorded | 6a0fe2eff984739ed6739c5e | | PAC-S/ViT-B | 54.3 | Not recorded | 6a0fe2eff984739ed6739c5e | | LongCLIP-S/ViT-L | 53.9 | Not recorded | 6a0fe2eff984739ed6739c5e | | FLEUR | 53 | Not recorded | 6a0fe2eff984739ed6739c5e | | LongCLIP-S/ViT-B | 53 | Not recorded | 6a0fe2eff984739ed6739c5e | | CLIP-S/ViT-B | 52.3 | Not recorded | 6a0fe2eff984739ed6739c5e | | VQAScore (CLIP-FlanT5-XXL) | 41 | Not recorded | 6a0fe2eff984739ed6739c5e | | SPECS | 30.4 | Not recorded | 6a0fe2eff984739ed6739c5e | ### BEiTScore-L/14 Kendall's tau-c: 60.2. Result ID: 6a0ffe7afbc373592c0861fd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size (M)":"674.69","GFLOPs":"296.73"}. This record does not assert independent reproduction. ### BEiTScore-B/32 Kendall's tau-c: 59.4. Result ID: 6a0ffe7afbc373592c0861fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size (M)":"222.28","GFLOPs":"83.85"}. This record does not assert independent reproduction. ### BEiTScore-L/14 w/o Stage 1 Kendall's tau-c: 57.8. Result ID: 6a0ffe7afbc373592c0861fb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size (M)":"674.69","GFLOPs":"296.73"}. This record does not assert independent reproduction. ### BEiTScore-B/32 w/o Stage 1 Kendall's tau-c: 57.6. Result ID: 6a0ffe7afbc373592c0861fa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size (M)":"222.28","GFLOPs":"83.85"}. This record does not assert independent reproduction. ### PAC-S++/ViT-L Kendall's tau-c: 57.4. Result ID: 6a0ffe7afbc373592c0861f8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size (M)":"430.58","GFLOPs":"56.26"}. This record does not assert independent reproduction. ### EXPERT Kendall's tau-c: 56.7. Result ID: 6a0ffe7afbc373592c0861ef. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size (M)":"13350.84","GFLOPs":"9317.47"}. This record does not assert independent reproduction. ### PAC-S/ViT-L Kendall's tau-c: 55.7. Result ID: 6a0ffe7afbc373592c0861f6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size (M)":"427.62","GFLOPs":"56.26"}. This record does not assert independent reproduction. ### CLIP-S/ViT-L Kendall's tau-c: 54.7. Result ID: 6a0ffe7afbc373592c0861f2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size (M)":"427.62","GFLOPs":"84.36"}. This record does not assert independent reproduction. ### PAC-S++/ViT-B Kendall's tau-c: 54.5. Result ID: 6a0ffe7afbc373592c0861f7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size (M)":"155.42","GFLOPs":"4.88"}. This record does not assert independent reproduction. ### PAC-S/ViT-B Kendall's tau-c: 54.3. Result ID: 6a0ffe7afbc373592c0861f5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size (M)":"151.28","GFLOPs":"4.88"}. This record does not assert independent reproduction. ### LongCLIP-S/ViT-L Kendall's tau-c: 53.9. Result ID: 6a0ffe7afbc373592c0861f4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size (M)":"427.75","GFLOPs":"98.9"}. This record does not assert independent reproduction. ### FLEUR Kendall's tau-c: 53. Result ID: 6a0ffe7afbc373592c0861ee. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size (M)":"13350.84","GFLOPs":"9317.47"}. This record does not assert independent reproduction. ### LongCLIP-S/ViT-B Kendall's tau-c: 53. Result ID: 6a0ffe7afbc373592c0861f3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size (M)":"149.84","GFLOPs":"26.24"}. This record does not assert independent reproduction. ### CLIP-S/ViT-B Kendall's tau-c: 52.3. Result ID: 6a0ffe7afbc373592c0861f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size (M)":"151.28","GFLOPs":"7.28"}. This record does not assert independent reproduction. ### VQAScore (CLIP-FlanT5-XXL) Kendall's tau-c: 41. Result ID: 6a0ffe7afbc373592c0861f0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size (M)":"11459.59","GFLOPs":"3742.1"}. This record does not assert independent reproduction. ### SPECS Kendall's tau-c: 30.4. Result ID: 6a0ffe7afbc373592c0861f9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size (M)":"151.49","GFLOPs":"9.2"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.