Helpfulness Evaluation on Figstep-audio Harmful-Safe
88.8BRRSARSteer
Evaluation Results
| Method | Links | |
|---|---|---|
| SARSteerModel=Kimi-Audio2025.10 | 88.8 | |
| SARSteerModel=Qwen2-Audio2025.10 | 79.95 | |
| SARSteerDefense runtime (s)=2662025.10 | 79.95 | |
| MDSteer-c2rModel=Kimi-Audio2025.10 | 79.68 | |
| No DefenseModel=Qwen2-Audio2025.10 | 70.2 | |
| No Defense2025.10 | 70.2 | |
| RRSDefense runtime (s)=11452025.10 | 70 | |
| AdaShieldModel=Qwen2-Audio2025.10 | 69.8 | |
| MDSteer-h2sModel=Kimi-Audio2025.10 | 68.8 | |
| FSDModel=Qwen2-Audio2025.10 | 63.2 | |
| No DefenseModel=Kimi-Audio2025.10 | 61.4 | |
| FSDModel=Kimi-Audio2025.10 | 61.2 | |
| MDSteer-h2sModel=Qwen2-Audio2025.10 | 60.8 | |
| MDSteer-c2rModel=Qwen2-Audio2025.10 | 54.2 | |
| AdaShieldModel=Kimi-Audio2025.10 | 52.6 |