Sarcasm Understanding on MuSTARD++
83.2F1 ScoreMuVaC
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MuVaC2026.01 | 83.2 | 81.2 | 85.3 | |
| ProSarcModality=Audio-only2026.06 | 75.3 | — | — | |
| Llama 3.1Fine-tuned=false2026.01 | 66.8 | 50.3 | 99.3 | |
| Tiwari et al., 2023Modality=Audio-only2026.06 | 66.6 | — | — | |
| Qwen 2.5Fine-tuned=false2026.01 | 65.5 | 57.4 | 76.2 | |
| Ray et al. (2022)Modality=Audio-only2026.06 | 64.5 | — | — | |
| Qwen 2.5 VLFine-tuned=true2026.01 | 63.8 | 74.4 | 55.8 | |
| MiniCPM-V 2.6Fine-tuned=false2026.01 | 61.3 | 52.4 | 73.7 | |
| Qwen 2.5 VLFine-tuned=false2026.01 | 53.4 | 63.2 | 46.2 | |
| Kimi VLFine-tuned=false2026.01 | 46.7 | 55.6 | 40.2 |