List your company
ResearchFormerly WizWand

Cross-modal retrieval on MSCOCO 1K

91.6Mean Recall (ja)MURAL-LARGE
30.96846.70962.4578.191Sep 10, 2021
Updated 8mo ago

Evaluation results

MethodLinks
MURAL-LARGEEvaluation Protocol=Fine-tuned, Data=AT+MBT, Type=Dual Encoder2021.0991.692.3
MURAL-BASEEvaluation Protocol=Fine-tuned, Data=AT+MBT, Type=Dual Encoder2021.0988.488.6
M3PEvaluation Protocol=Fine-tuned, Data=CC3m+Wiki, Type=Cross Encoder2021.0987.988.7
UC2Evaluation Protocol=Fine-tuned, Data=TrTrain(CC3m), Type=Cross Encoder2021.0987.588.1
ALIGN-BASEEvaluation Protocol=Fine-tuned, Data=TrTrain(AT-en), Type=Dual Encoder2021.0987.589
MURAL-BASEEvaluation Protocol=Fine-tuned, Data=TrTrain(CC12m)+EOBT, Type=Dual Encoder2021.0987.489.4
ALIGN-BASEEvaluation Protocol=Fine-tuned, Data=AT, Type=Dual Encoder2021.0986.789.2
MURAL-LARGEEvaluation Protocol=Zero-shot, Data=AT+MBT, Type=Dual Encoder2021.0981.384.4
SMALREvaluation Protocol=Fine-tuned, Data=no pretraining, Type=Dual Encoder2021.0977.581.5
MURAL-BASEEvaluation Protocol=Zero-shot, Data=AT+MBT, Type=Dual Encoder2021.0973.479.2
MURAL-BASEEvaluation Protocol=Zero-shot, Data=TrTrain(CC12m)+EOBT, Type=Dual Encoder2021.0972.578.1
ALIGN-BASE-ENEvaluation Protocol=Zero-shot, Data=AT-en-translate-test, Type=Dual Encoder2021.0971.580
ALIGN-BASEEvaluation Protocol=Zero-shot, Data=AT, Type=Dual Encoder2021.0970.979.5
ALIGN-L2Evaluation Protocol=Zero-shot, Data=AT-en, Type=Dual Encoder2021.0970.9—
ALIGN-BASEEvaluation Protocol=Zero-shot, Data=TrTrain(AT-en), Type=Dual Encoder2021.0970.677.1
M3PEvaluation Protocol=Zero-shot, Data=CC3m+Wiki, Type=Cross Encoder2021.0933.363.1