Metaphor Classification on MMSD Metaphor style 2.0 (test)
73.19AccuracyGemini 2.5 Flash
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemini 2.5 FlashPrompting=zero-shot2026.01 | 73.19 | 0.76 | |
| SFT on Combined → GRPO (Combined)Prompting=zero-shot, Setup=Combined2026.01 | 69.14 | 0.8 | |
| SFT on Combined → GRPO (Style specific)Prompting=zero-shot, Setup=Style specific2026.01 | 68.19 | 0.79 | |
| LLaMA 90B Vision InstructPrompting=zero-shot2026.01 | 67.56 | 0.76 | |
| Qwen2.5-VL 32B InstructPrompting=zero-shot2026.01 | 61.31 | 0.69 | |
| Gemma 3 27BPrompting=zero-shot2026.01 | 58.44 | 0.64 | |
| Phi-4 MultimodalPrompting=zero-shot2026.01 | 55.71 | 0.55 | |
| LLaVA 1.5 7BPrompting=zero-shot2026.01 | 53.68 | 0.56 |