Intervention Generation on ICMM (test)
4.98FluencyAnnotated Intervention
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Annotated InterventionMethodology=Human Annotated2024.06 | 4.98 | 4.87 | 4.46 | 4.91 | |
| MemeGuardBase LLM=GPT3.5-Turbo2024.06 | 4.82 | 4.16 | 3.97 | 4.13 | |
| OCR + MiniGPT4Base LLM=GPT3.5-Turbo2024.06 | 4.81 | 3.82 | 3.47 | 3.61 | |
| OCR + VLMemeBase LLM=GPT3.5-Turbo2024.06 | 4.81 | 3.95 | 3.91 | 4.05 | |
| OCRBase LLM=GPT3.5-Turbo2024.06 | 4.79 | 3.6 | 3.32 | 3.57 | |
| MemeGuardBase LLM=FLAN-T52024.06 | 4.39 | 3.32 | 2.24 | 3.27 | |
| OCR + VLMemeBase LLM=FLAN-T52024.06 | 4.35 | 3.26 | 2.23 | 3.19 | |
| OCR + MiniGPT4Base LLM=FLAN-T52024.06 | 4.31 | 2.81 | 2.19 | 2.79 | |
| OCRBase LLM=FLAN-T52024.06 | 4.27 | 2.69 | 2.16 | 2.72 |