List your company

Image-to-image matching on Factify-V (test)

80.6AccuracyGPT-4V + CoCoT
48.77657.03865.373.562Jan 5, 2024

Evaluation results

MethodLinks
GPT-4V + CoCoTprompting_strategy=CoCoT, zero-shot=true, web_version_as_of=December 30, 20232024.0180.6
GEMINI + CCoTprompting_strategy=CCoT, zero-shot=true, temperature=0.4, TopK=32, TopP=1, max_length=40962024.0180.2
GEMINI + CoCoTprompting_strategy=CoCoT, zero-shot=true, temperature=0.4, TopK=32, TopP=1, max_length=40962024.0177.8
MMICL + CoCoTprompting_strategy=CoCoT, zero-shot=true, beam_search_width=82024.0177
GPT-4Vprompting_strategy=standard, zero-shot=true, web_version_as_of=December 30, 20232024.0174
MMICL + CCoTprompting_strategy=CCoT, zero-shot=true, beam_search_width=82024.0173.2
MMICL + DDCoTprompting_strategy=DDCoT, zero-shot=true, beam_search_width=82024.0168.4
GEMINI + DDCoTprompting_strategy=DDCoT, zero-shot=true, temperature=0.4, TopK=32, TopP=1, max_length=40962024.0165.4
OPENFLAMINGO + CoCoTprompting_strategy=CoCoT, zero-shot=true, beam_search_width=32024.0165
MMICLprompting_strategy=standard, zero-shot=true, beam_search_width=82024.0164.6
OPENFLAMINGO + CCoTprompting_strategy=CCoT, zero-shot=true, beam_search_width=32024.0163.2
OPENFLAMINGO + DDCoTprompting_strategy=DDCoT, zero-shot=true, beam_search_width=32024.0158.4
GEMINIprompting_strategy=standard, zero-shot=true, temperature=0.4, TopK=32, TopP=1, max_length=40962024.0158
OPENFLAMINGOprompting_strategy=standard, zero-shot=true, beam_search_width=32024.0154
Random Choiceevaluation_type=baseline2024.0150