Natural Language Visual Reasoning on NLVR2 (test)
85.36AccuracyI2M2
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| I2M2INTRA I=true, INTRA T=true, INTER=true2024.05 | 85.36 | — | — | |
| Inter-modality modelingINTRA I=false, INTRA T=false, INTER=true2024.05 | 85.29 | — | — | |
| VK-OOD2023.02 | 83.9 | — | — | |
| VinVL-BModel Scale=Base2023.02 | 83.1 | — | — | |
| METERFine-tuning protocol=original fine-tuned2023.05 | 82.7 | — | — | |
| METER + PuMerFine-tuning protocol=PuMer fine-tuned2023.05 | 82.2 | 1.79 | 38 | |
| ALBEF(4M)Pre-train images=4M2023.02 | 80.5 | — | — | |
| FLAVA2023.02 | 79 | — | — | |
| PixelBERT2023.02 | 77.2 | — | — | |
| UNITER-BModel Scale=Base2023.02 | 75.8 | — | — | |
| ViLTFine-tuning protocol=original fine-tuned2023.05 | 75.5 | — | — | |
| ViLT + PuMerFine-tuning protocol=PuMer fine-tuned2023.05 | 74.9 | 1.74 | 45 | |
| ViLT-BModel Scale=Base2023.02 | 74.6 | — | — | |
| Intra-modality modelingINTRA I=true, INTRA T=true, INTER=false2024.05 | 54.31 | — | — | |
| Uni-modal (Text)INTRA I=false, INTRA T=true, INTER=false2024.05 | 52.97 | — | — | |
| Uni-modal (Image)INTRA I=true, INTRA T=false, INTER=false2024.05 | 52.05 | — | — |