List your company
ResearchFormerly WizWand

Multi-class sarcasm detection on Sarc7

36.64Macro F1Gemini 2.5
19.750424.135228.5232.9048May 31, 2025
Updated 4mo ago

Evaluation results

MethodLinks
Gemini 2.5Prompting Technique=Emotion-based2025.0536.64
Claude 3.5 SonnetPrompting Technique=Few-shot2025.0534.87
Claude 3.5 SonnetPrompting Technique=Emotion-based2025.0534.87
Gemini 2.5Prompting Technique=Few-shot2025.0532.74
GPT-4oPrompting Technique=Few-shot2025.0532.55
Gemini 2.5Prompting Technique=CoT2025.0531.41
Claude 3.5 SonnetPrompting Technique=0-shot2025.0529.64
Llama-4 MaverickPrompting Technique=Emotion-based2025.0528.41
Gemini 2.5Prompting Technique=0-shot2025.0527.6
GPT-4oPrompting Technique=CoT2025.0526.74
Claude 3.5 SonnetPrompting Technique=CoT2025.0524.71
Llama-4 MaverickPrompting Technique=Few-shot2025.0523.4
GPT-4oPrompting Technique=Emotion-based2025.0522.33
Llama-4 MaverickPrompting Technique=0-shot2025.0521.84
Qwen 2.5Prompting Technique=Emotion-based2025.0521.24
Qwen 2.5Prompting Technique=0-shot2025.0521.16
GPT-4oPrompting Technique=0-shot2025.0520.89
Qwen 2.5Prompting Technique=Few-shot2025.0520.75
Qwen 2.5Prompting Technique=CoT2025.0520.52
Llama-4 MaverickPrompting Technique=CoT2025.0520.4