List your company
ResearchFormerly WizWand

Image Captioning on COCO (test) (CIDEr)

149.8CIDErGIT2
3.88841.76979.65117.531Apr 29, 2022Jan 4, 2023Sep 12, 2023May 20, 2024Jan 26, 2025Oct 4, 2025Jun 12, 2026
Updated 4mo ago

Evaluation results

MethodLinks
GIT22022.05149.8
OFAEvaluation Protocol=Fine-tuned2022.04149.6
Unrestricted SotA (OFA)Evaluation Protocol=Fine-tuned2022.04149.6
GIT2022.05148.8
SimVLMEvaluation Protocol=Fine-tuned2022.04143.3
Restricted SotA+ (SimVLM)Evaluation Protocol=Fine-tuned2022.04143.3
Ours2024.10138.7
Prior SOTA2022.05138.7
X-InstructBLIP2024.10138.2
FlamingoEvaluation Protocol=Fine-tuned2022.04138.1
OSCAR-BaseParams (million)=146.52023.10137.6
CoCa-LargeParams (million)=672.12023.10132.3
CLIP-ViLpParams (million)=187.72023.10127.9
CoCa-BaseParams (million)=293.12023.10126.7
Unified-IO2023.06122.3
CoCa-Tiny_12 (OPTIMA)Teacher=CoCa-Large, Params (million)=101.8, Inference Speedup=3.4x2023.10121.2
ShikraModel Size=13B2023.06117.5
DistilVLM_12x384Teacher=OSCAR-Base, Params (million)=30.0, Inference Speedup=3.1x2023.10117.1
CoCa-Tiny_12Teacher=CoCa-Large, Params (million)=101.8, Inference Speedup=3.4x2023.10116.8
MiniVLM_12x384Teacher=OSCAR-Base, Params (million)=30.0, Inference Speedup=3.1x2023.10115
VisionLLM2023.06114.2
FlamingoShots=32, Evaluation Protocol=In-context learning2022.04113.8
CoCa-Tiny_6 (OPTIMA)Teacher=CoCa-Large, Params (million)=54.5, Inference Speedup=6.2x2023.10113.5
CoCa-Tiny_6Teacher=CoCa-Large, Params (million)=54.5, Inference Speedup=6.2x2023.10112.2
ALVTSTokens Retained=192, Reduction Ratio=67%2026.06111.68
LLaVA-1.5-7BTokens Retained=576, Retention Ratio=100%2026.06110.52
ALVTSTokens Retained=128, Reduction Ratio=78%2026.06110.32
PDropTokens Retained=192, Reduction Ratio=67%2026.06109.28
DARTTokens Retained=192, Reduction Ratio=67%2026.06108.93
PDropTokens Retained=128, Reduction Ratio=78%2026.06107.86
DARTTokens Retained=128, Reduction Ratio=78%2026.06107.8
FastVTokens Retained=192, Reduction Ratio=67%2026.06107.49
ALVTSTokens Retained=64, Reduction Ratio=89%2026.06105.89
DARTTokens Retained=64, Reduction Ratio=89%2026.06103.89
FastVTokens Retained=128, Reduction Ratio=78%2026.06101.99
AnyMAL 13B (ViT-G)Zero-shot=true, LLM size=13B, Vision Backbone=ViT-G2023.0999.5
PDropTokens Retained=64, Reduction Ratio=89%2026.0699.26
AnyMAL 70B (ViT-G)Zero-shot=true, LLM size=70B, Vision Backbone=ViT-G2023.0995.9
ViECap + SeTaPruned %=31.7%, Zero-shot=true2025.0395.3
ViECapPruned %=0%, Zero-shot=true2025.0395.2
ViECap + SeTaPruned %=50.1%, Zero-shot=true2025.0394.6
ViECap + SeTaPruned %=41.8%, Zero-shot=true2025.0394.5
ViECap + InfoBatchPruned %=23.6%, Zero-shot=true2025.0394.4
ViECap + InfoBatchPruned %=34.1%, Zero-shot=true2025.0393.7
ViECap + InfoBatchPruned %=45.9%, Zero-shot=true2025.0393
IDEFICS-80BZero-shot=true, Model size=80B2023.0991.8
Kosmos-12023.0684.7
FM-80BModel Size=80B2023.0684.3
Flamingo-80BZero-shot=true, Model size=80B2023.0984.3
FastVTokens Retained=64, Reduction Ratio=89%2026.0682.62
OpenFlamingo-v2 9BZero-shot=true, Model size=9B2023.0979.5
FM-9BModel Size=9B2023.0679.4
Flamingo-9BZero-shot=true, Model size=9B2023.0979.4
Flamingo-3BZero-shot=true, Model size=3B2023.0973
CM3LeonZero-shot=true2023.0961.6
IDEFICS-9BZero-shot=true, Model size=9B2023.0946
VTWTokens Retained=192, Reduction Ratio=67%2026.0639.85
VTWTokens Retained=64, Reduction Ratio=89%2026.069.8
VTWTokens Retained=128, Reduction Ratio=78%2026.069.5