Social interaction reasoning on MuMA-ToM
98.9Belief ScoreHuman
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Human2025.06 | 98.9 | 94.4 | 87.1 | 93.5 | |
| Scalable Bayesian ToM PlannerComponents=8B+405B2025.06 | 94 | 64.5 | 67.5 | 75.3 | |
| Llava 1.6Model size=34B2025.06 | 93.6 | 37.2 | 27.5 | 52.8 | |
| LIMPBackbone=GPT-4o2025.06 | 93.4 | 67.7 | 68.7 | 76.6 | |
| Gemini 1.5 Pro2025.06 | 78.9 | 43.9 | 46.9 | 56.4 | |
| Llava 1.6Model size=13B2025.06 | 70.2 | 43.2 | 17.9 | 43.7 | |
| VideoLlama 2Model size=7B2025.06 | 70.1 | 45.6 | 37.7 | 51.1 | |
| GPT-4o2025.06 | 67.9 | 39.6 | 44.4 | 50.6 | |
| InternVL 2Model size=26B2025.06 | 59.3 | 44.9 | 35.5 | 46.6 | |
| Gemini 1.5 Flash2025.06 | 53.9 | 33 | 41.4 | 42.7 | |
| BIPALMBackbone=llama2-7B2025.06 | 41.2 | 34.1 | 30.6 | 33.9 |