Safety-Awareness on MSSBench
70.5Safety RateGemini-2.5-pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-2.5-proModel=Gemini-2.5-pro2025.12 | 70.5 | |
| Claude-3.5-SonnetModel=Claude-3.5-Sonnet2025.12 | 69.2 | |
| TRRBackbone=Qwen2.5VL-7B, Alignment Method=TRR2025.12 | 65.6 | |
| Safework-R1-7BModel=Safework-R1-7B2025.12 | 65.1 | |
| TRRBackbone=Qwen2.5VL-32B, Alignment Method=TRR2025.12 | 65.1 | |
| MSR-AlignBackbone=Qwen2.5VL-32B, Alignment Method=MSR-Align2025.12 | 64.5 | |
| MSR-AlignBackbone=Qwen2.5VL-7B, Alignment Method=MSR-Align2025.12 | 63.4 | |
| GPT-4oModel=GPT-4o2025.12 | 58.8 | |
| TiSBackbone=Qwen2.5VL-32B, Alignment Method=TiS2025.12 | 55.8 | |
| Qwen2.5VL-32BBackbone=Qwen2.5VL-32B, Alignment Method=None2025.12 | 53.1 | |
| TiSBackbone=Qwen2.5VL-7B, Alignment Method=TiS2025.12 | 51.9 | |
| Qwen2.5VL-7BBackbone=Qwen2.5VL-7B, Alignment Method=None2025.12 | 51.7 |