Visual Reasoning on MaRVL
71.66IDCCLM4M
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CCLM4MEvaluation Mode=Zero-shot2023.06 | 71.66 | 67.21 | 60.36 | 66.75 | 69.86 | |
| CLiCOTEAEvaluation Mode=Zero-shot2023.06 | 69.55 | 71.3 | 63.93 | 70.72 | 64.93 | |
| CCLM3MEvaluation Mode=Zero-shot2023.06 | 67.81 | 61.55 | 60.28 | 69.6 | 70.52 | |
| UC2Evaluation Mode=Zero-shot2023.06 | 56.74 | 52.62 | 60.47 | 56.7 | 59.88 | |
| M3PEvaluation Mode=Zero-shot2023.06 | 56.47 | 55.69 | 56.04 | 56.78 | 55.04 | |
| xUNITEREvaluation Mode=Zero-shot2023.06 | 55.14 | 55.51 | 53.06 | 56.19 | 53.06 | |
| mUNITEREvaluation Mode=Zero-shot2023.06 | 54.79 | 51.17 | 52.66 | 54.66 | 55.34 |