Procedural Multimedia Reasoning on PMR (test)
84.7AccuracyModCR
Evaluation results
| Method | Links | |
|---|---|---|
| ModCRTraining Protocol=fine-tune VLMs2023.05 | 84.7 | |
| ModCRTraining Protocol=frozen VLMs2023.05 | 84.3 | |
| ERNIE-VL-LModel Scale=Large2023.05 | 79.9 | |
| VL-BERT-LModel Scale=Large2023.05 | 79.3 | |
| OFA-LModel Scale=Large2023.05 | 79.1 | |
| ERNIE-VL-BModel Scale=Base2023.05 | 79 | |
| MVPTR2023.05 | 78.9 | |
| CALEC2023.05 | 78.7 | |
| UNITER-BModel Scale=Base2023.05 | 77.4 | |
| UNITER-LModel Scale=Large2023.05 | 77 | |
| PromptFuse2023.05 | 76.5 | |
| Oscar-BModel Scale=Base2023.05 | 76.1 | |
| VL-BERT-BModel Scale=Base2023.05 | 75.4 | |
| RoBERTa-LModel Scale=Large2023.05 | 75 | |
| BERT-BModel Scale=Base2023.05 | 65.2 |