Image Captioning on COCO (test) (CIDEr)
149.8CIDErGIT2
Evaluation Results
| Method | Links | |
|---|---|---|
| GIT22022.05 | 149.8 | |
| OFAEvaluation Protocol=Fine-tuned2022.04 | 149.6 | |
| Unrestricted SotA (OFA)Evaluation Protocol=Fine-tuned2022.04 | 149.6 | |
| GIT2022.05 | 148.8 | |
| SimVLMEvaluation Protocol=Fine-tuned2022.04 | 143.3 | |
| Restricted SotA+ (SimVLM)Evaluation Protocol=Fine-tuned2022.04 | 143.3 | |
| Ours2024.10 | 138.7 | |
| Prior SOTA2022.05 | 138.7 | |
| X-InstructBLIP2024.10 | 138.2 | |
| FlamingoEvaluation Protocol=Fine-tuned2022.04 | 138.1 | |
| OSCAR-BaseParams (million)=146.52023.10 | 137.6 | |
| CoCa-LargeParams (million)=672.12023.10 | 132.3 | |
| CLIP-ViLpParams (million)=187.72023.10 | 127.9 | |
| CoCa-BaseParams (million)=293.12023.10 | 126.7 | |
| Unified-IO2023.06 | 122.3 | |
| CoCa-Tiny_12 (OPTIMA)Teacher=CoCa-Large, Params (million)=101.8, Inference Speedup=3.4x2023.10 | 121.2 | |
| ShikraModel Size=13B2023.06 | 117.5 | |
| DistilVLM_12x384Teacher=OSCAR-Base, Params (million)=30.0, Inference Speedup=3.1x2023.10 | 117.1 | |
| CoCa-Tiny_12Teacher=CoCa-Large, Params (million)=101.8, Inference Speedup=3.4x2023.10 | 116.8 | |
| MiniVLM_12x384Teacher=OSCAR-Base, Params (million)=30.0, Inference Speedup=3.1x2023.10 | 115 | |
| VisionLLM2023.06 | 114.2 | |
| FlamingoShots=32, Evaluation Protocol=In-context learning2022.04 | 113.8 | |
| CoCa-Tiny_6 (OPTIMA)Teacher=CoCa-Large, Params (million)=54.5, Inference Speedup=6.2x2023.10 | 113.5 | |
| CoCa-Tiny_6Teacher=CoCa-Large, Params (million)=54.5, Inference Speedup=6.2x2023.10 | 112.2 | |
| ALVTSTokens Retained=192, Reduction Ratio=67%2026.06 | 111.68 | |
| LLaVA-1.5-7BTokens Retained=576, Retention Ratio=100%2026.06 | 110.52 | |
| ALVTSTokens Retained=128, Reduction Ratio=78%2026.06 | 110.32 | |
| PDropTokens Retained=192, Reduction Ratio=67%2026.06 | 109.28 | |
| DARTTokens Retained=192, Reduction Ratio=67%2026.06 | 108.93 | |
| PDropTokens Retained=128, Reduction Ratio=78%2026.06 | 107.86 | |
| DARTTokens Retained=128, Reduction Ratio=78%2026.06 | 107.8 | |
| FastVTokens Retained=192, Reduction Ratio=67%2026.06 | 107.49 | |
| ALVTSTokens Retained=64, Reduction Ratio=89%2026.06 | 105.89 | |
| DARTTokens Retained=64, Reduction Ratio=89%2026.06 | 103.89 | |
| FastVTokens Retained=128, Reduction Ratio=78%2026.06 | 101.99 | |
| AnyMAL 13B (ViT-G)Zero-shot=true, LLM size=13B, Vision Backbone=ViT-G2023.09 | 99.5 | |
| PDropTokens Retained=64, Reduction Ratio=89%2026.06 | 99.26 | |
| AnyMAL 70B (ViT-G)Zero-shot=true, LLM size=70B, Vision Backbone=ViT-G2023.09 | 95.9 | |
| ViECap + SeTaPruned %=31.7%, Zero-shot=true2025.03 | 95.3 | |
| ViECapPruned %=0%, Zero-shot=true2025.03 | 95.2 | |
| ViECap + SeTaPruned %=50.1%, Zero-shot=true2025.03 | 94.6 | |
| ViECap + SeTaPruned %=41.8%, Zero-shot=true2025.03 | 94.5 | |
| ViECap + InfoBatchPruned %=23.6%, Zero-shot=true2025.03 | 94.4 | |
| ViECap + InfoBatchPruned %=34.1%, Zero-shot=true2025.03 | 93.7 | |
| ViECap + InfoBatchPruned %=45.9%, Zero-shot=true2025.03 | 93 | |
| IDEFICS-80BZero-shot=true, Model size=80B2023.09 | 91.8 | |
| Kosmos-12023.06 | 84.7 | |
| FM-80BModel Size=80B2023.06 | 84.3 | |
| Flamingo-80BZero-shot=true, Model size=80B2023.09 | 84.3 | |
| FastVTokens Retained=64, Reduction Ratio=89%2026.06 | 82.62 | |
| OpenFlamingo-v2 9BZero-shot=true, Model size=9B2023.09 | 79.5 | |
| FM-9BModel Size=9B2023.06 | 79.4 | |
| Flamingo-9BZero-shot=true, Model size=9B2023.09 | 79.4 | |
| Flamingo-3BZero-shot=true, Model size=3B2023.09 | 73 | |
| CM3LeonZero-shot=true2023.09 | 61.6 | |
| IDEFICS-9BZero-shot=true, Model size=9B2023.09 | 46 | |
| VTWTokens Retained=192, Reduction Ratio=67%2026.06 | 39.85 | |
| VTWTokens Retained=64, Reduction Ratio=89%2026.06 | 9.8 | |
| VTWTokens Retained=128, Reduction Ratio=78%2026.06 | 9.5 |