List your company
ResearchFormerly WizWand

Harmfulness Evaluation on AdvBench-audio Harmful

26.35ASR ScoreMDSteer-h2s
-1.0546.060513.17520.2895Oct 20, 2025
Updated 6mo ago

Evaluation results

MethodLinks
MDSteer-h2sModel=Qwen2-Audio2025.1026.35
MDSteer-c2rModel=Qwen2-Audio2025.1023.46
MDSteer-h2sModel=Kimi-Audio2025.1010.38
RRSDefense runtime (s)=11452025.103.27
No DefenseModel=Qwen2-Audio2025.102.88
No Defense2025.102.88
AdaShieldModel=Qwen2-Audio2025.101.15
FSDModel=Qwen2-Audio2025.100.78
SARSteerModel=Qwen2-Audio2025.100.58
SARSteerDefense runtime (s)=2662025.100.58
No DefenseModel=Kimi-Audio2025.100
AdaShieldModel=Kimi-Audio2025.100
FSDModel=Kimi-Audio2025.100
MDSteer-c2rModel=Kimi-Audio2025.100
SARSteerModel=Kimi-Audio2025.100