Safety Evaluation on MM-SafetyBench SD 1.0
48.3Illegal Activity ScoreBASE
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BASEBackbone=llava-1.5-7b-hf, Setting=SD2025.12 | 48.3 | 59.2 | 76.9 | 58.1 | 62.2 | 50 | 67 | 59 | 50 | 51.3 | 56 | 71.1 | 57.8 | 59 | |
| InferAlignerBackbone=llava-1.5-7b-hf, Abbreviation=ALI, Setting=SD2025.12 | 44.8 | 42.9 | 53.8 | 53.5 | 45.9 | 37 | 57.6 | 38.5 | 50 | 51.3 | 38 | 60.5 | 40 | 47.2 | |
| ECSOBackbone=llava-1.5-7b-hf, Setting=SD2025.12 | 20.7 | 20.4 | 53.8 | 11.6 | 29.7 | 15.2 | 36.4 | 30.8 | 34.1 | 23.1 | 26 | 26.3 | 28.9 | 27.5 | |
| SGMBackbone=llava-1.5-7b-hf, Setting=SD2025.12 | 13.8 | 16.3 | 0 | 7 | 0 | 2.2 | 51.5 | 5.1 | 6.8 | 5.1 | 8 | 10.5 | 6.7 | 10.2 | |
| SGM⋆Backbone=llava-1.5-7b-hf, Setting=SD2025.12 | 0 | 4.1 | 0 | 0 | 0 | 0 | 21.2 | 2.6 | 2.3 | 0 | 2 | 0 | 0 | 2.5 |