Harmfulness Evaluation on Figstep-audio Harmful
90.8ASRMDSteer-c2r
Evaluation Results
| Method | Links | |
|---|---|---|
| MDSteer-c2rModel=Qwen2-Audio2025.10 | 90.8 | |
| MDSteer-h2sModel=Qwen2-Audio2025.10 | 84 | |
| MDSteer-h2sModel=Kimi-Audio2025.10 | 72.4 | |
| RRSDefense runtime (s)=11452025.10 | 52.4 | |
| No DefenseModel=Qwen2-Audio2025.10 | 51.6 | |
| No Defense2025.10 | 51.6 | |
| MDSteer-c2rModel=Kimi-Audio2025.10 | 30.71 | |
| AdaShieldModel=Qwen2-Audio2025.10 | 30 | |
| FSDModel=Kimi-Audio2025.10 | 19.6 | |
| No DefenseModel=Kimi-Audio2025.10 | 15.6 | |
| FSDModel=Qwen2-Audio2025.10 | 12 | |
| SARSteerModel=Qwen2-Audio2025.10 | 10.8 | |
| SARSteerDefense runtime (s)=2662025.10 | 10.8 | |
| SARSteerModel=Kimi-Audio2025.10 | 10 | |
| AdaShieldModel=Kimi-Audio2025.10 | 0 |