Risk Identification on MSSBench
96.05RIRGPT-4o-mini
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4o-miniModel Category=Proprietary Models2026.03 | 96.05 | 84.21 | |
| Gemini-3-ProModel Category=Proprietary Models2026.03 | 85.53 | 10.53 | |
| HomeGuard-8BModel Category=Ours, Parameters=8B2026.03 | 77.63 | 25 | |
| HomeGuard-4BModel Category=Ours, Parameters=4B2026.03 | 64.47 | 21.05 | |
| Qwen3-VL-235B-A22B-ThinkingModel Category=Open-Sourced VLMs2026.03 | 62.67 | 22.37 | |
| RoboBrain2.5-8BModel Category=Open-Sourced VLMs2026.03 | 59.21 | 22.37 | |
| Gemini-2.5-flashModel Category=Proprietary Models2026.03 | 53.95 | 28.95 | |
| PoexModel Category=Runtime Safeguard2026.03 | 53.95 | 27.63 | |
| Qwen3-VL-8B-ThinkingModel Category=Open-Sourced VLMs2026.03 | 52.63 | 27.11 | |
| Qwen3-VL-4B-ThinkingModel Category=Open-Sourced VLMs2026.03 | 51.31 | 23.68 | |
| ThinkSafeModel Category=Runtime Safeguard2026.03 | 50 | 30.26 | |
| AgentSpecModel Category=Runtime Safeguard2026.03 | 50 | 25 |