List your company

Image-to-image matching on Raven-50 (test)

45AccuracyGPT-4V + CoCoT
8.618.0527.536.95Jan 5, 2024

Evaluation results

MethodLinks
GPT-4V + CoCoTprompting_strategy=CoCoT, zero-shot=true, web_version_as_of=December 30, 20232024.0145
GPT-4Vprompting_strategy=standard, zero-shot=true, web_version_as_of=December 30, 20232024.0130
OPENFLAMINGO + CoCoTprompting_strategy=CoCoT, zero-shot=true, beam_search_width=32024.0126
MMICL + CCoTprompting_strategy=CCoT, zero-shot=true, beam_search_width=82024.0126
MMICL + CoCoTprompting_strategy=CoCoT, zero-shot=true, beam_search_width=82024.0126
OPENFLAMINGOprompting_strategy=standard, zero-shot=true, beam_search_width=32024.0124
OPENFLAMINGO + DDCoTprompting_strategy=DDCoT, zero-shot=true, beam_search_width=32024.0124
OPENFLAMINGO + CCoTprompting_strategy=CCoT, zero-shot=true, beam_search_width=32024.0124
MMICLprompting_strategy=standard, zero-shot=true, beam_search_width=82024.0122
GEMINI + CoCoTprompting_strategy=CoCoT, zero-shot=true, temperature=0.4, TopK=32, TopP=1, max_length=40962024.0122
GEMINI + CCoTprompting_strategy=CCoT, zero-shot=true, temperature=0.4, TopK=32, TopP=1, max_length=40962024.0120
GEMINIprompting_strategy=standard, zero-shot=true, temperature=0.4, TopK=32, TopP=1, max_length=40962024.0118
Random Choiceevaluation_type=baseline2024.0117
GEMINI + DDCoTprompting_strategy=DDCoT, zero-shot=true, temperature=0.4, TopK=32, TopP=1, max_length=40962024.0112
MMICL + DDCoTprompting_strategy=DDCoT, zero-shot=true, beam_search_width=82024.0110