Visual Entailment on XVNLI (test)
78.15AccuracyCLiCoTEA
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CLiCoTEASetting=Zero-shot2023.06 | 78.15 | — | — | — | — | |
| CCLM_3MSetting=Zero-shot2023.06 | 74.64 | — | — | — | — | |
| CCLM_4MSetting=Zero-shot2023.06 | 73.32 | — | — | — | — | |
| UC2Setting=Zero-shot2023.06 | 62.05 | — | — | — | — | |
| xUNITERSetting=Zero-shot2023.06 | 58.48 | — | — | — | — | |
| M3PSetting=Zero-shot2023.06 | 58.25 | — | — | — | — | |
| mUNITERSetting=Zero-shot2023.06 | 53.69 | — | — | — | — | |
| CCLM3Mevaluation_mode=zero-shot2023.06 | — | 71.04 | 75.8 | 78.14 | 73.56 | |
| CCLM4Mevaluation_mode=zero-shot2023.06 | — | 69.68 | 73.65 | 77.54 | 72.4 | |
| CLiCOTEAevaluation_mode=zero-shot2023.06 | — | 75.83 | 83.48 | 80.17 | 73.13 | |
| M3Pevaluation_mode=zero-shot2023.06 | — | 55.24 | 58.85 | 56.36 | 62.54 | |
| mUNITERevaluation_mode=zero-shot2023.06 | — | 46.73 | 56.96 | 59.36 | 51.72 | |
| UC2evaluation_mode=zero-shot2023.06 | — | 56.19 | 57.47 | 69.67 | 64.86 | |
| xUNITERevaluation_mode=zero-shot2023.06 | — | 51.98 | 58.94 | 63.32 | 59.71 |