Safety Evaluation on CATQA Direct
1Safety Score (1-ASR)PSI
Evaluation results
| Method | Links | |
|---|---|---|
| PSIBackbone Model=HuatuoGPT-Vision-7B2025.12 | 1 | |
| RESTABackbone Model=Lingshu-7B2025.12 | 0.9945 | |
| RESTABackbone Model=HuatuoGPT-Vision-7B2025.12 | 0.9473 | |
| PSIBackbone Model=Lingshu-7B2025.12 | 0.94 | |
| ModelMergeBackbone Model=Lingshu-7B2025.12 | 0.9145 | |
| OriginalBackbone Model=Lingshu-7B2025.12 | 0.7 | |
| ModelMergeBackbone Model=HuatuoGPT-Vision-7B2025.12 | 0.5927 | |
| OriginalBackbone Model=HuatuoGPT-Vision-7B2025.12 | 0 |