Embodied Question Answering on PersonEQA
75.41Total AccuracyHUMEMBR
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| HUMEMBRBackbone LLM=Gemini 3 Flash2026.06 | 75.41 | 60.95 | 81.4 | 65.94 | 81.48 | 92.31 | 77.08 | 106,347 | |
| Full-context BaselineBackbone LLM=Gemini 3 Flash, Context=All captions in context2026.06 | 67.33 | 65.71 | 81.4 | 67.39 | 75 | 34.62 | 68.75 | 631,651 | |
| HUMEMBRBackbone LLM=Qwen3-VL 235B2026.06 | 66.01 | 57.14 | 71.32 | 63.04 | 59.34 | 78.21 | 75 | 11,589 | |
| HUMEMBRBackbone LLM=Qwen3-235B Thinking2026.06 | 63.2 | 48.57 | 62.02 | 60.15 | 63.89 | 95.9 | 68.75 | 12,415 | |
| HUMEMBRBackbone LLM=Qwen3-VL 235B, Configuration=3 func2026.06 | 63.04 | 44.76 | 70.54 | 60.15 | 51.85 | 84.62 | 81.25 | 12,976 | |
| HUMEMBRBackbone LLM=Qwen3-VL 235B, Configuration=–ReID2026.06 | 60.49 | 48.57 | 74.21 | 60.15 | 56.48 | 60.25 | 60.42 | 11,790 | |
| HUMEMBRBackbone LLM=Qwen3-30B Thinking2026.06 | 57.92 | 47.62 | 60.47 | 53.61 | 50.93 | 79.49 | 66.67 | 9,430 |