Explanation Generation on MemeMQA (test)
0.37WERMM-COT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MM-COTPrompting=with Lecture2024.05 | 0.37 | 0.37 | 0.58 | 0.42 | 0.31 | |
| ARSENAL2024.05 | 0.6 | 0.57 | 0.77 | 0.23 | 0.41 | |
| UM.TEXT.T5Modality=Unimodal Text, Backbone=T52024.05 | 0.67 | 0.65 | 0.82 | 0.18 | 0.53 | |
| MM.VIT.BERT.BERTModality=Multimodal, Backbone=ViT/BERT2024.05 | 0.89 | 0.81 | 0.95 | 0.05 | 0.6 | |
| UM.IMAGE.BEIT.BERT.BERTModality=Unimodal Image, Backbone=BEIT/BERT2024.05 | 0.9 | 0.81 | 0.95 | 0.05 | 0.6 |