Social Intelligence Reasoning on IntentBench
68.6Why ScoreGemini-2.5-Pro (think)
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Gemini-2.5-Pro (think)2026.06 | 68.6 | 67.4 | 57.1 | 64 | 70 | 67.2 | |
| GPT-o12026.06 | 68.2 | 65.8 | 57.1 | 76 | 68.3 | 66.7 | |
| MODF-SIRLLM Size=7B2026.06 | 67.2 | 69.5 | 64.3 | 84 | 75.5 | 70.3 | |
| HumanOmniV2LLM Size=7B2026.06 | 66.8 | 67.1 | 50 | 84 | 72.4 | 69.3 | |
| Qwen2.5-OmniLLM Size=7B2026.06 | 62.6 | 63.4 | 57.1 | 76 | 69 | 64.2 | |
| GPT-4o2026.06 | 61.5 | 55.7 | 35.7 | 76 | 63.3 | 60 | |
| OlaLLM Size=7B2026.06 | 60.6 | 55.4 | 64.3 | 76 | 62.9 | 57.4 | |
| MiniCPM-oLLM Size=8B2026.06 | 57.9 | 53.5 | 57.1 | 68 | 61.1 | 54.5 | |
| VITA-1.5LLM Size=7B2026.06 | 53.2 | 49.4 | 71.4 | 64 | 61.1 | 54.2 |