Humanoid Object Search on H*Bench
66.33Success Rate (Overall)InternVL3.5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| InternVL3.5Params=8B, Imaginator=Enabled2026.05 | 66.33 | 76.1 | 68.18 | 62.4 | |
| Gemini-2.5Params=Pro, Imaginator=Enabled2026.05 | 66.1 | 89.6 | 68.8 | 56.8 | |
| Gemini-2.5-Pro + ImaginatorActor Family=Gemini-2.5, Params=Pro, Imaginator=Spatial Priors2026.05 | 66.1 | 89.6 | 68.8 | 56.8 | |
| Qwen3-VLParams=235B, Imaginator=Enabled2026.05 | 65.04 | 81.46 | 60.23 | 59.29 | |
| Qwen3-VL-235B + ImaginatorActor Family=Qwen3-VL, Params=235B, Imaginator=Spatial Priors2026.05 | 65.04 | 81.46 | 60.23 | 59.29 | |
| Gemini-2.5Params=Flash, Imaginator=Enabled2026.05 | 63.2 | 86.3 | 69.3 | 53.7 | |
| Gemini-2.5-Flash + ImaginatorActor Family=Gemini-2.5, Params=Flash, Imaginator=Spatial Priors2026.05 | 63.2 | 86.3 | 69.3 | 53.7 | |
| HVSParams=3B, Imaginator=Enabled2026.05 | 62.75 | 75.77 | 64.2 | 57.61 | |
| HVS-3B + ImaginatorActor Family=HVS, Params=3B, Imaginator=Spatial Priors2026.05 | 62.75 | 75.77 | 64.2 | 57.61 | |
| InternVL3.5Params=4B, Imaginator=Enabled2026.05 | 62.42 | 69.59 | 62.5 | 59.66 | |
| Qwen2.5-VLParams=72B, Imaginator=Enabled2026.05 | 62.25 | 70.08 | 60.8 | 59.42 | |
| Qwen2.5-VL-72B + ImaginatorActor Family=Qwen2.5-VL, Params=72B, Imaginator=Spatial Priors2026.05 | 62.25 | 70.08 | 60.8 | 59.42 | |
| Gemma-3Params=4B, Imaginator=Enabled2026.05 | 57.75 | 72.03 | 60.23 | 52.02 | |
| Gemma-3-4B + ImaginatorActor Family=Gemma-3, Params=4B, Imaginator=Spatial Priors2026.05 | 57.75 | 72.03 | 60.23 | 52.02 | |
| Qwen3-VLParams=32B, Imaginator=Enabled2026.05 | 57.46 | 73.98 | 51.7 | 51.77 | |
| Qwen3-VL-32B + ImaginatorActor Family=Qwen3-VL, Params=32B, Imaginator=Spatial Priors2026.05 | 57.46 | 73.98 | 51.7 | 51.77 | |
| Qwen2.5-VLParams=7B, Imaginator=Enabled2026.05 | 57.42 | 70.73 | 51.7 | 52.95 | |
| Qwen2.5-VL-7B + ImaginatorActor Family=Qwen2.5-VL, Params=7B, Imaginator=Spatial Priors2026.05 | 57.42 | 70.73 | 51.7 | 52.95 | |
| Qwen3-VLParams=30B-A3B, Imaginator=Enabled2026.05 | 56.67 | 74.15 | 55.68 | 50.09 | |
| Gemini-2.5Params=Pro, Imaginator=Disabled2026.05 | 55 | 88 | 62.5 | 41.6 | |
| Gemini-2.5-ProActor Family=Gemini-2.5, Params=Pro, Imaginator=Internal CoT2026.05 | 55 | 88 | 62.5 | 41.6 | |
| Gemma-3Params=12B, Imaginator=Enabled2026.05 | 54.62 | 63.9 | 48.86 | 51.71 | |
| Gemma-3-12B + ImaginatorActor Family=Gemma-3, Params=12B, Imaginator=Spatial Priors2026.05 | 54.62 | 63.9 | 48.86 | 51.71 | |
| Qwen2.5-VLParams=3B, Imaginator=Enabled2026.05 | 49.54 | 59.19 | 51.7 | 45.62 | |
| Qwen2.5-VL-3B + ImaginatorActor Family=Qwen2.5-VL, Params=3B, Imaginator=Spatial Priors2026.05 | 49.54 | 59.19 | 51.7 | 45.62 | |
| HVSParams=3B, Imaginator=Disabled2026.05 | 48.04 | 61.79 | 26.14 | 45.18 | |
| HVS-3BActor Family=HVS, Params=3B, Imaginator=Internal CoT2026.05 | 48.04 | 61.79 | 26.14 | 45.18 | |
| Gemini-2.5Params=Flash, Imaginator=Disabled2026.05 | 43.7 | 79.5 | 59.7 | 28.3 | |
| Gemini-2.5-FlashActor Family=Gemini-2.5, Params=Flash, Imaginator=Internal CoT2026.05 | 43.7 | 79.5 | 59.7 | 28.3 | |
| Qwen2.5-VLParams=32B, Imaginator=Enabled2026.05 | 41.12 | 66.34 | 36.36 | 32.01 | |
| Qwen2.5-VL + EAGORParams=7B, Zero-shot=true2026.07 | 40.1 | 54.2 | 39.4 | 34.6 | |
| Gemma-3 + EAGORParams=12B, Zero-shot=true2026.07 | 36.55 | 56.7 | 38.3 | 31.65 | |
| Qwen3-VLParams=32B, Imaginator=Disabled2026.05 | 34.38 | 66.83 | 36.36 | 21.75 | |
| Qwen3-VL-32BActor Family=Qwen3-VL, Params=32B, Imaginator=Internal CoT2026.05 | 34.38 | 66.83 | 36.36 | 21.75 | |
| Kimi-VLParams=A3B, Imaginator=Enabled2026.05 | 32.46 | 40 | 27.84 | 30.08 | |
| Kimi-VL-A3B + ImaginatorActor Family=Kimi-VL, Params=A3B, Imaginator=Spatial Priors2026.05 | 32.46 | 40 | 27.84 | 30.08 | |
| Qwen2.5-VLParams=32B, Imaginator=Disabled2026.05 | 32.08 | 50.57 | 27.84 | 25.48 | |
| Qwen2.5-VLParams=72B, Imaginator=Disabled2026.05 | 29.54 | 36.91 | 21.59 | 27.59 | |
| Qwen2.5-VL-72BActor Family=Qwen2.5-VL, Params=72B, Imaginator=Internal CoT2026.05 | 29.54 | 36.91 | 21.59 | 27.59 | |
| Qwen2.5-VLParams=7B, Zero-shot=true2026.07 | 27.24 | 37.6 | 27.8 | 23.1 | |
| Qwen2.5-VL + EAGORParams=3B, Zero-shot=true2026.07 | 26.4 | 45.1 | 21.7 | 20.8 | |
| Gemma-3Params=12B, Zero-shot=true2026.07 | 25.67 | 35.1 | 24 | 22.4 | |
| Qwen3-VLParams=30B-A3B, Imaginator=Disabled2026.05 | 24.96 | 54.63 | 30.11 | 13.05 | |
| Gemma-3 + EAGORParams=4B, Zero-shot=true2026.07 | 24.8 | 40.2 | 24.45 | 18.9 | |
| Qwen3-VLParams=235B, Imaginator=Disabled2026.05 | 23.62 | 57.24 | 26.7 | 10.44 | |
| Qwen3-VL-235BActor Family=Qwen3-VL, Params=235B, Imaginator=Internal CoT2026.05 | 23.62 | 57.24 | 26.7 | 10.44 | |
| Gemma-3Params=12B, Imaginator=Disabled2026.05 | 22.88 | 54.96 | 32.39 | 9.57 | |
| Gemma-3-12BActor Family=Gemma-3, Params=12B, Imaginator=Internal CoT2026.05 | 22.88 | 54.96 | 32.39 | 9.57 | |
| Qwen2.5-VLParams=3B, Imaginator=Disabled2026.05 | 21.17 | 18.54 | 16.48 | 22.68 | |
| Qwen2.5-VL-3BActor Family=Qwen2.5-VL, Params=3B, Imaginator=Internal CoT2026.05 | 21.17 | 18.54 | 16.48 | 22.68 | |
| Qwen2.5-VLParams=3B, Zero-shot=true2026.07 | 20.71 | 32 | 22.1 | 16.4 | |
| Gemma-3Params=4B, Zero-shot=true2026.07 | 20.6 | 29.5 | 19.2 | 17.5 | |
| Gemma-3Params=4B, Imaginator=Disabled2026.05 | 18.17 | 41.79 | 25.57 | 8.33 | |
| Gemma-3-4BActor Family=Gemma-3, Params=4B, Imaginator=Internal CoT2026.05 | 18.17 | 41.79 | 25.57 | 8.33 | |
| LLaVA-v1.5Params=3B, Zero-shot=true2026.07 | 13.6 | 39.2 | 10.6 | 11.2 | |
| Qwen2.5-VLParams=7B, Imaginator=Disabled2026.05 | 12.79 | 31.22 | 7.39 | 6.34 | |
| Qwen2.5-VL-7BActor Family=Qwen2.5-VL, Params=7B, Imaginator=Internal CoT2026.05 | 12.79 | 31.22 | 7.39 | 6.34 | |
| InternVL3.5Params=8B, Imaginator=Disabled2026.05 | 11.04 | 23.74 | 6.25 | 6.71 | |
| InternVL3.5Params=4B, Imaginator=Disabled2026.05 | 10 | 14.8 | 13.07 | 7.83 | |
| Kimi-VLParams=A3B, Imaginator=Disabled2026.05 | 4.33 | 12.36 | 0.57 | 1.68 | |
| Kimi-VL-A3BActor Family=Kimi-VL, Params=A3B, Imaginator=Internal CoT2026.05 | 4.33 | 12.36 | 0.57 | 1.68 |