Procedural Multimodal Machine Comprehension on RecipeQA (test)
77.6ClozeHuman
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Human2022.04 | 77.6 | 81.6 | 64 | 74.4 | |
| TMEG2022.04 | 73.27 | 70.38 | 65.56 | 69.73 | |
| TMEGContrastive Coherence Loss=false2022.04 | 71.66 | 68.54 | 64.54 | 68.24 | |
| TMEGModal Encoding=false2022.04 | 71.5 | 69.63 | 64.15 | 68.42 | |
| TMEGTemporal Encoding=false2022.04 | 70.18 | 68.81 | 63.91 | 67.63 | |
| TMEGTemporal Encoding=false, Modal Encoding=false2022.04 | 68.97 | 67.72 | 63.34 | 66.67 | |
| VisualBERT2022.04 | 66.49 | 68.15 | 63.09 | 65.91 | |
| MLMM-Trans2022.04 | 65.57 | 67.33 | 63.75 | 65.55 | |
| PRN2022.04 | 56.31 | 53.64 | 62.77 | 57.57 | |
| HS2022.04 | 27.35 | 65.8 | 40.88 | 44.68 |