Multimodal Sarcasm Detection on redEval
84.8F1 ScoreProCrit
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ProCritProtocol=Fine-tuned, Perspective=Adaptive, Generation Mode=Draft-only2026.05 | 84.8 | 87.2 | 79.2 | 91.4 | |
| ProCritProtocol=Fine-tuned, Perspective=Adaptive2026.05 | 83.7 | 85.7 | 75.7 | 93.7 | |
| Plain CoT ReasonerProtocol=Fine-tuned, Perspective=None2026.05 | 82.6 | 84.8 | 74.9 | 92.2 | |
| Fixed-role ReasonerProtocol=Fine-tuned, Perspective=Predefined2026.05 | 81.6 | 83.9 | 74.3 | 90.6 | |
| ProCritProtocol=Zero-shot, Perspective=Adaptive2026.05 | 71.4 | 76.8 | 69.2 | 73.6 | |
| Zero-shot CoTProtocol=Zero-shot, Perspective=None2026.05 | 70.6 | 78.2 | 75.1 | 66.6 | |
| Automatic Prompt EngineerProtocol=Zero-shot, Perspective=None2026.05 | 70.2 | 78.2 | 75.9 | 65.3 | |
| Commander-GPTProtocol=Zero-shot, Perspective=Predefined2026.05 | 70.1 | 72.3 | 60.9 | 82.5 | |
| Generated Knowledge PromptingProtocol=Zero-shot, Perspective=None2026.05 | 61.5 | 75.4 | 80.1 | 49.9 | |
| S3AgentProtocol=Zero-shot, Perspective=Predefined2026.05 | 61 | 73.8 | 73.6 | 52.2 | |
| IRONICProtocol=Zero-shot, Perspective=Predefined2026.05 | 59.1 | 76 | 89.7 | 44.1 | |
| Plan-and-SolveProtocol=Zero-shot, Perspective=None2026.05 | 58.9 | 72 | 77.4 | 47.6 |