Multimodal Classification on Hateful Memes
64.6Overall ScoreMMICL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MMICLIn-Context Learning (ICL) setting=w/ ICL examples (4), Base Language Model / Backbone=Instruct-FLAN-T5-XXL2023.09 | 64.6 | — | |
| KOSMOS-1In-Context Learning (ICL) setting=w/o ICL example2023.09 | 63.9 | — | |
| Flamingo-9BIn-Context Learning (ICL) setting=w/ ICL examples (4)2023.09 | 62.7 | — | |
| BLIP-2In-Context Learning (ICL) setting=w/o ICL example, Base Language Model / Backbone=FLANT5-XXL2023.09 | 62.25 | — | |
| MMICLIn-Context Learning (ICL) setting=w/o ICL example, Base Language Model / Backbone=Instruct-FLAN-T5-XXL2023.09 | 62.23 | — | |
| InstructBLIPIn-Context Learning (ICL) setting=w/o ICL example, Base Language Model / Backbone=FLANT5-XXL2023.09 | 61.7 | — | |
| MMICLIn-Context Learning (ICL) setting=w/ ICL examples (4), Base Language Model / Backbone=FLAN-T5-XXL2023.09 | 61.12 | — | |
| MMICLIn-Context Learning (ICL) setting=w/o ICL example, Base Language Model / Backbone=Instruct-FLAN-T5-XL2023.09 | 61.12 | — | |
| MMICLIn-Context Learning (ICL) setting=w/ ICL examples (4), Base Language Model / Backbone=Instruct-FLAN-T5-XL2023.09 | 61.12 | — | |
| MMICLIn-Context Learning (ICL) setting=w/ ICL examples (4), Base Language Model / Backbone=FLAN-T5-XL2023.09 | 60.8 | — | |
| MMICLIn-Context Learning (ICL) setting=w/o ICL example, Base Language Model / Backbone=FLAN-T5-XXL2023.09 | 60.32 | — | |
| MMICLIn-Context Learning (ICL) setting=w/o ICL example, Base Language Model / Backbone=FLAN-T5-XL2023.09 | 60.28 | — | |
| BLIP-2In-Context Learning (ICL) setting=w/o ICL example, Base Language Model / Backbone=FLANT5-XL2023.09 | 60 | — | |
| InstructBLIPIn-Context Learning (ICL) setting=w/o ICL example, Base Language Model / Backbone=FLANT5-XL2023.09 | 58.54 | — | |
| Flamingo-9BIn-Context Learning (ICL) setting=w/o ICL example2023.09 | 57 | — | |
| Flamingo-3BIn-Context Learning (ICL) setting=w/o ICL example2023.09 | 53.7 | — | |
| Flamingo-3BIn-Context Learning (ICL) setting=w/ ICL examples (4)2023.09 | 53.6 | — | |
| InfoReg2025.03 | — | 56.2 | |
| Joint training2025.03 | — | 55 |