List your company
ResearchFormerly WizWand

Video Captioning Evaluation Correlation on VATEX Eval

50.8Kendall's Tau-bRIGEL
10.905621.262831.6241.9772Sep 20, 2025Nov 6, 2025Dec 23, 2025Feb 8, 2026Mar 27, 2026May 13, 2026Jun 29, 2026
Updated 4mo ago

Evaluation results

MethodLinks
RIGELSetting=Reference-based2026.0650.864
G-VEvalReference Setting=9-References, Metric Category=Multimodal - image-based2025.0948.1—
G-VEvalSetting=Reference-based2026.0648.1—
RIGELSetting=Reference-based2026.0645.657.8
G-VEvalReference Setting=1-Reference, Metric Category=Multimodal - image-based2025.0944.9—
G-VEvalSetting=Reference-based2026.0644.9—
VC-Inspector-7BReference Setting=No Reference, Metric Category=Multimodal - video-based, Model Scale=7B2025.0942.5845.99
RIGELSetting=Reference-free2026.0642.153.7
RIGELSetting=Reference-free2026.0642.153.7
RefPAC-S++Setting=Reference-based2026.0639.850.8
G-VEvalReference Setting=No Reference, Metric Category=Multimodal - image-based2025.0939.4—
G-VEvalSetting=Reference-free2026.0639.4—
G-VEvalSetting=Reference-free2026.0639.4—
PAC-SReference Setting=9-References, Metric Category=Multimodal - image-based2025.0938.1—
RefPAC-SSetting=Reference-based2026.0638.148.8
VC-Inspector-3BReference Setting=No Reference, Metric Category=Multimodal - video-based, Model Scale=3B2025.0937.9942.45
EMScoreSetting=Reference-based2026.0636.847.2
EMScoreReference Setting=9-References, Metric Category=Multimodal - image-based2025.0936.6647
Soft-SPICEReference Setting=9-References, Metric Category=Language-based2025.0936.3146.41
FactVCReference Setting=9-References, Metric Category=Multimodal - image-based2025.0936.1846.33
CLAIRReference Setting=1-Reference, Metric Category=Language-based2025.0936—
CLIPScoreReference Setting=9-References, Metric Category=Multimodal - image-based2025.0935.2145.28
CLAIRReference Setting=9-References, Metric Category=Language-based2025.0934.8—
Qwen2.5-VL-7BReference Setting=No Reference, Metric Category=Multimodal - video-based, Model Scale=7B2025.0934.739.4
RefPAC-S++Setting=Reference-based2026.0632.241.5
PAC-SReference Setting=1-Reference, Metric Category=Multimodal - image-based2025.0931.4—
RefPAC-SSetting=Reference-based2026.0631.440.5
Qwen2.5-VL-3BReference Setting=No Reference, Metric Category=Multimodal - video-based, Model Scale=3B2025.0931.2936.43
ViCLIPScoreReference Setting=No Reference, Metric Category=Multimodal - video-based2025.0930.9239.86
FactVCReference Setting=1-Reference, Metric Category=Multimodal - image-based2025.0928.7837.22
BLEU_1Reference Setting=9-References, Metric Category=Language-based2025.0928.736.88
EMScoreReference Setting=1-Reference, Metric Category=Multimodal - image-based2025.0928.6337.05
EMScoreSetting=Reference-based2026.0628.637.1
PAC-S++Setting=Reference-free2026.0628.136.4
PAC-S++Setting=Reference-free2026.0628.136.4
CIDErReference Setting=9-References, Metric Category=Language-based2025.0927.9236.18
METEORReference Setting=9-References, Metric Category=Language-based2025.0927.6435.76
SPICEReference Setting=9-References, Metric Category=Language-based2025.0927.4135.4
CLIPScoreReference Setting=1-Reference, Metric Category=Multimodal - image-based2025.0927.3935.49
SPICE-factualReference Setting=9-References, Metric Category=Language-based2025.0926.0535.58
PAC-SReference Setting=No Reference, Metric Category=Multimodal - image-based2025.0925.1—
PAC-SSetting=Reference-free2026.0625.132.6
PAC-SSetting=Reference-free2026.0625.132.6
BERTScoreReference Setting=9-References, Metric Category=Language-based2025.0925.0532.37
ROUGE-LReference Setting=9-References, Metric Category=Language-based2025.0923.9431.06
EMScoreSetting=Reference-free2026.0623.230.3
EMScoreSetting=Reference-free2026.0623.230.3
EMScoreReference Setting=No Reference, Metric Category=Multimodal - image-based2025.0922.8829.79
FactVCReference Setting=No Reference, Metric Category=Multimodal - image-based2025.0922.7929.69
BLEU_4Reference Setting=9-References, Metric Category=Language-based2025.0922.7625.6
CLIPScoreReference Setting=No Reference, Metric Category=Multimodal - image-based2025.0922.3329.09
Soft-SPICEReference Setting=1-Reference, Metric Category=Language-based2025.0921.2527.61
CIDErReference Setting=1-Reference, Metric Category=Language-based2025.0917.6223.02
METEORReference Setting=1-Reference, Metric Category=Language-based2025.0916.6821.8
BERTScoreReference Setting=1-Reference, Metric Category=Language-based2025.0915.2419.82
SPICEReference Setting=1-Reference, Metric Category=Language-based2025.0914.818.78
SPICE-factualReference Setting=1-Reference, Metric Category=Language-based2025.0913.5917.04
ROUGE-LReference Setting=1-Reference, Metric Category=Language-based2025.0912.9416.89
BLEU_1Reference Setting=1-Reference, Metric Category=Language-based2025.0912.6516.52
BLEU_4Reference Setting=1-Reference, Metric Category=Language-based2025.0912.4414.81