Multimodal Humor Explanation on New Yorker
76.7PrecisionCOT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| COTModel=Flash1.52025.02 | 76.7 | 13.1 | 22.3 | |
| ZSModel=Flash1.52025.02 | 76.6 | 24.1 | 36.6 | |
| BOTTLEHUMORModel=Flash1.52025.02 | 76.2 | 24.1 | 36.7 | |
| COTModel=GPT4o2025.02 | 76 | 26.1 | 38.8 | |
| ZSModel=GPT4o2025.02 | 75.4 | 42 | 53.9 | |
| SR-noCModel=GPT4o2025.02 | 75.2 | 45.8 | 56.9 | |
| SRModel=GPT4o2025.02 | 75.1 | 44.6 | 56 | |
| BOTTLEHUMORModel=GPT4o2025.02 | 74.5 | 47.7 | 58.2 | |
| SR-noCModel=Flash1.52025.02 | 74 | 21.2 | 32.9 | |
| SRModel=Flash1.52025.02 | 73.7 | 22.9 | 34.9 | |
| COTModel=Qwen22025.02 | 70.9 | 11 | 19 | |
| BOTTLEHUMORModel=Qwen22025.02 | 68.4 | 17.7 | 28.1 | |
| SRModel=Qwen22025.02 | 67.4 | 17.8 | 28.2 | |
| SR-noCModel=Qwen22025.02 | 67.3 | 18.6 | 29.1 | |
| ZSModel=Qwen22025.02 | 66.7 | 19.4 | 30.1 | |
| COTModel=Phi2025.02 | 57.4 | 8.5 | 14.8 | |
| BOTTLEHUMORModel=Phi2025.02 | 55.8 | 15 | 23.6 | |
| ZSModel=Phi2025.02 | 51.2 | 14.8 | 23 | |
| SR-noCModel=Phi2025.02 | 51.2 | 15.1 | 23.3 | |
| SRModel=Phi2025.02 | 49.1 | 13 | 20.6 |