Procedural Multimodal Machine Comprehension on CraftQA (test)
55.33ClozeHuman
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Human2022.04 | 55.33 | 61.8 | 54.6 | 57.24 | |
| TMEG2022.04 | 48.01 | 51.36 | 49.25 | 49.54 | |
| TMEGContrastive Coherence Loss=false2022.04 | 47.49 | 50.03 | 48.79 | 48.77 | |
| TMEGModal Encoding=false2022.04 | 46.67 | 49.06 | 48.35 | 48.02 | |
| TMEGTemporal Encoding=false2022.04 | 45.91 | 47.71 | 47.24 | 46.95 | |
| TMEGTemporal Encoding=false, Modal Encoding=false2022.04 | 44.87 | 46.29 | 46.77 | 45.98 | |
| VisualBERT2022.04 | 40.56 | 47.84 | 46.18 | 44.86 | |
| MLMM-Trans2022.04 | 39.43 | 46.52 | 43.62 | 43.2 | |
| PRN2022.04 | 35.14 | 33.67 | 42.31 | 37.04 | |
| HS2022.04 | 27.81 | 42.61 | 35.23 | 35.22 |