List your company
ResearchFormerly WizWand

Harmfulness Evaluation on SORRY-Bench audio

78.41ASR AccuracyMDSteer-c2r
-2.897218.211439.3260.4286Oct 20, 2025
Updated 6mo ago

Evaluation results

MethodLinks
MDSteer-c2rModel=Qwen2-Audio2025.1078.41
MDSteer-h2sModel=Qwen2-Audio2025.1075.45
MDSteer-h2sModel=Kimi-Audio2025.1055
RRSDefense runtime (s)=11452025.1038.41
No DefenseModel=Qwen2-Audio2025.1027.5
No Defense2025.1027.5
MDSteer-c2rModel=Kimi-Audio2025.1021.59
AdaShieldModel=Qwen2-Audio2025.1020.45
SARSteerModel=Qwen2-Audio2025.1013.41
SARSteerDefense runtime (s)=2662025.1013.41
No DefenseModel=Kimi-Audio2025.1012.5
FSDModel=Kimi-Audio2025.1011.14
FSDModel=Qwen2-Audio2025.1010.55
SARSteerModel=Kimi-Audio2025.106.14
AdaShieldModel=Kimi-Audio2025.100.23