Harmfulness Evaluation on AdvBench-audio Harmful
26.35ASR ScoreMDSteer-h2s
Evaluation Results
| Method | Links | |
|---|---|---|
| MDSteer-h2sModel=Qwen2-Audio2025.10 | 26.35 | |
| MDSteer-c2rModel=Qwen2-Audio2025.10 | 23.46 | |
| MDSteer-h2sModel=Kimi-Audio2025.10 | 10.38 | |
| RRSDefense runtime (s)=11452025.10 | 3.27 | |
| No DefenseModel=Qwen2-Audio2025.10 | 2.88 | |
| No Defense2025.10 | 2.88 | |
| AdaShieldModel=Qwen2-Audio2025.10 | 1.15 | |
| FSDModel=Qwen2-Audio2025.10 | 0.78 | |
| SARSteerModel=Qwen2-Audio2025.10 | 0.58 | |
| SARSteerDefense runtime (s)=2662025.10 | 0.58 | |
| No DefenseModel=Kimi-Audio2025.10 | 0 | |
| AdaShieldModel=Kimi-Audio2025.10 | 0 | |
| FSDModel=Kimi-Audio2025.10 | 0 | |
| MDSteer-c2rModel=Kimi-Audio2025.10 | 0 | |
| SARSteerModel=Kimi-Audio2025.10 | 0 |