Hazard Identification and Grounding in Household Scenarios on HomeSafe-Bench
90.98RIRHomeGuard-8B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HomeGuard-8BModel Category=Ours2026.03 | 90.98 | 74.9 | 72.06 | 55.62 | 13.14 | |
| HomeGuard-4BModel Category=Ours2026.03 | 90 | 63.72 | 67.09 | 48.73 | 21.96 | |
| GPT-4o-miniModel Category=Proprietary Models2026.03 | 88.04 | 39.41 | 37.49 | 13.28 | 55.15 | |
| Gemini-2.5-flashModel Category=Proprietary Models2026.03 | 87.84 | 57.25 | 35.87 | 27.9 | 42.65 | |
| Gemini-3-proModel Category=Proprietary Models2026.03 | 87.45 | 60.98 | 67.45 | 52.17 | 25.23 | |
| Qwen3-VL-235B-ThinkingModel Category=Open-Sourced VLMs2026.03 | 77.17 | 45.08 | 69.64 | 41.24 | 34.69 | |
| Qwen3-VL-8B-ThinkingModel Category=Open-Sourced VLMs2026.03 | 67.58 | 33.2 | 57.32 | 26.94 | 32.62 | |
| Qwen3-VL-4B-ThinkingModel Category=Open-Sourced VLMs2026.03 | 66.67 | 33.14 | 59.02 | 22.12 | 29.31 | |
| AgentSpecModel Category=Runtime Safeguard, Base Model=Qwen3-VL-8B-Thinking2026.03 | 66.67 | 36.67 | — | — | 28.41 | |
| RoboBrain2.5-8BModel Category=Open-Sourced VLMs2026.03 | 56.15 | 24 | 49.61 | 12.45 | 41.18 | |
| PoexModel Category=Runtime Safeguard, Base Model=Qwen3-VL-8B-Thinking2026.03 | 45.19 | 23.97 | — | — | 16.47 | |
| ThinkSafeModel Category=Runtime Safeguard, Base Model=Qwen3-VL-8B-Thinking2026.03 | 44.31 | 23.53 | — | — | 15.29 |