Harmfulness Evaluation on AJailBench Harmful
49ASRMDSteer-c2r
Evaluation Results
| Method | Links | |
|---|---|---|
| MDSteer-c2rModel=Qwen2-Audio2025.10 | 49 | |
| No DefenseModel=Qwen2-Audio2025.10 | 48.76 | |
| MDSteer-h2sModel=Kimi-Audio2025.10 | 43.5 | |
| MDSteer-h2sModel=Qwen2-Audio2025.10 | 38.5 | |
| MDSteer-c2rModel=Kimi-Audio2025.10 | 24 | |
| AdaShieldModel=Qwen2-Audio2025.10 | 19 | |
| FSDModel=Qwen2-Audio2025.10 | 19 | |
| SARSteerModel=Qwen2-Audio2025.10 | 18 | |
| No DefenseModel=Kimi-Audio2025.10 | 17 | |
| FSDModel=Kimi-Audio2025.10 | 12.5 | |
| SARSteerModel=Kimi-Audio2025.10 | 11 | |
| AdaShieldModel=Kimi-Audio2025.10 | 1.5 |