Funny caption generation on Humor in AI (#1000-1009)
76.32Top-1 AccuracyHOMER
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HOMERBase LLM=GPT-4o2026.02 | 76.32 | 90.5 | 94.19 | |
| HumorousAIBase LLM=GPT-4o2026.02 | 73.46 | 85.42 | 88.4 | |
| HOMERBase LLM=Claude-42026.02 | 71.06 | 85.47 | 89 | |
| Self-consistencyBase LLM=GPT-4o2026.02 | 69.42 | 85.51 | 88.93 | |
| Few-shotBase LLM=Claude-42026.02 | 69.19 | 83.7 | 87 | |
| Self-consistencyBase LLM=Claude-42026.02 | 68.73 | 82.5 | 86.33 | |
| CLoTBase LLM=GPT-4o2026.02 | 68.7 | 78 | 81.17 | |
| HumorousAIBase LLM=Claude-42026.02 | 68.66 | 82.06 | 85.98 | |
| LoLBase LLM=GPT-4o2026.02 | 67.29 | 83.83 | 88.73 | |
| LoLBase LLM=Claude-42026.02 | 67.06 | 83.3 | 87.89 | |
| Few-shotBase LLM=GPT-4o2026.02 | 65.59 | 88.39 | 90.83 | |
| CoTBase LLM=GPT-4o2026.02 | 61.58 | 86.9 | 88.65 | |
| CLoTBase LLM=Claude-42026.02 | 53.65 | 61.44 | 63 | |
| CoTBase LLM=Claude-42026.02 | 42.27 | 41.87 | 51.67 | |
| HOMERBase LLM=Qwen-VL (7B)2026.02 | 32.92 | 50.52 | 58.53 | |
| Few-shotBase LLM=Qwen-VL (7B)2026.02 | 26.46 | 38.79 | 44.67 | |
| HumorousAIBase LLM=Qwen-VL (7B)2026.02 | 25.4 | 37 | 41.33 | |
| Self-consistencyBase LLM=Qwen-VL (7B)2026.02 | 25.06 | 36.53 | 41.33 | |
| PhunnyBase LLM=GPT-4o2026.02 | 23.8 | 38.74 | 45.99 | |
| CLoTBase LLM=Qwen-VL (7B)2026.02 | 23 | 29.33 | 46.67 | |
| CoTBase LLM=Qwen-VL (7B)2026.02 | 22.85 | 35.11 | 40.63 | |
| LoLBase LLM=Qwen-VL (7B)2026.02 | 21.37 | 34.29 | 40.54 | |
| HOMERBase LLM=LLaVA-1.5 (7B)2026.02 | 20.67 | 24.44 | 27.67 | |
| HumorousAIBase LLM=LLaVA-1.5 (7B)2026.02 | 18.67 | 20 | 21.73 | |
| PhunnyBase LLM=Claude-42026.02 | 18.03 | 40.06 | 53.59 | |
| Few-shotBase LLM=LLaVA-1.5 (7B)2026.02 | 16.44 | 18.67 | 18.89 | |
| CLoTBase LLM=LLaVA-1.5 (7B)2026.02 | 16 | 19.6 | 20 | |
| PhunnyBase LLM=LLaVA-1.5 (7B)2026.02 | 13.33 | 18.67 | 22.13 | |
| LoLBase LLM=LLaVA-1.5 (7B)2026.02 | 12 | 17.33 | 20 | |
| Self-consistencyBase LLM=LLaVA-1.5 (7B)2026.02 | 8 | 9.44 | 10 | |
| PhunnyBase LLM=Qwen-VL (7B)2026.02 | 2.96 | 8.89 | 14.81 | |
| CoTBase LLM=LLaVA-1.5 (7B)2026.02 | 1.78 | 2.22 | 2.22 |