Visual Entailment on e-SNLI-VE e-ViL (test)
85.7Human EvalOFA-X
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| OFA-Xmodel_variant=large (470M parameters), training=single-task fine-tuned2022.12 | 85.7 | 18.6 | 80.9 | 80.9 | |
| Ground-truth2022.12 | 85 | — | — | — | |
| OFA-XMTmodel_variant=large (470M parameters), training=multi-task pre-training (e-ViL-combined)2022.12 | 80.4 | 17.9 | 80.3 | 78.9 | |
| e-UG2022.12 | 68.9 | 19.6 | 81.7 | 79.5 | |
| NLX-GPT2022.12 | 67.4 | 18.8 | 80.8 | 73.91 | |
| PJ-X2022.12 | 59.6 | 14.7 | 79.1 | 69.2 | |
| FME2022.12 | 58.5 | 15.6 | 79.7 | 73.7 |