Belief reasoning on EgoToM
72AccuracyHumans
Evaluation results
| Method | Links | |
|---|---|---|
| HumansSetting=Baseline, Nframe=last 30s2026.03 | 72 | |
| HumansSetting=Baseline, Nframe=last 5s2026.03 | 71 | |
| Gemini-2.5-FlashSetting=Baseline, Nframe=242026.03 | 46.7 | |
| Video-Llama2-72BSetting=Baseline, Nframe=82026.03 | 46 | |
| LLaVA-Next-Video-7BSetting=w/o \delta _{V,l}^h, Nframe=242026.03 | 45.3 | |
| LLaVA-Next-Video-7BSetting=+\alpha \Delta, Nframe=242026.03 | 45.3 | |
| GPT-4-TurboSetting=Baseline, Nframe=202026.03 | 45 | |
| Qwen2.5-VL-7BSetting=+\alpha \Delta, Nframe=242026.03 | 42 | |
| Qwen2.5-VL-7BSetting=w/o \delta _{V,l}^h, Nframe=242026.03 | 40.6 | |
| LLaVA-Next-Video-7BSetting=w/o \delta _{T,l}^h, Nframe=242026.03 | 39.2 | |
| LLaVA-Next-Video-7BSetting=Rnd-\Delta, Nframe=242026.03 | 39.2 | |
| CogVLM2Setting=Baseline, Nframe=242026.03 | 39 | |
| LLaVA-Next-Video-7BSetting=Baseline, Nframe=242026.03 | 38.9 | |
| Qwen2.5-VL-7BSetting=Rnd-\Delta, Nframe=242026.03 | 36 | |
| Qwen2.5-VL-7BSetting=Baseline, Nframe=242026.03 | 35.6 | |
| Qwen2.5-VL-7BSetting=w/o \delta _{T,l}^h, Nframe=242026.03 | 35.6 | |
| Qwen2.5-VL-7BSetting=-\alpha \Delta, Nframe=242026.03 | 24.3 | |
| LLaVA-Next-Video-7BSetting=-\alpha \Delta, Nframe=242026.03 | 20.6 | |
| GPT-4oSetting=Baseline, Nframe=242026.03 | 20.4 |