General Utility on AirBench 1-10
8.1Speech ScoreSARSteer
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SARSteerModel=Qwen2-Audio2025.10 | 8.1 | 7.27 | 7.36 | 7.41 | 7.53 | |
| MDSteer-c2rModel=Qwen2-Audio2025.10 | 7.72 | 7.26 | 7.41 | 7.39 | 7.44 | |
| No DefenseModel=Qwen2-Audio2025.10 | 7.67 | 7.34 | 7.36 | 7.37 | 7.43 | |
| FSDModel=Qwen2-Audio2025.10 | 7.64 | 7.08 | 7.17 | 7.35 | 7.31 | |
| MDSteer-h2sModel=Kimi-Audio2025.10 | 7.63 | 7.02 | 6.95 | 7.27 | 7.21 | |
| MDSteer-h2sModel=Qwen2-Audio2025.10 | 7.6 | 7.09 | 7.13 | 7.46 | 7.32 | |
| MDSteer-c2rModel=Kimi-Audio2025.10 | 7.58 | 7.01 | 7 | 7.2 | 7.2 | |
| No DefenseModel=Kimi-Audio2025.10 | 7.56 | 7.14 | 7.07 | 7.04 | 7.2 | |
| AdaShieldModel=Qwen2-Audio2025.10 | 7.54 | 7.3 | 7.46 | 7.26 | 7.39 | |
| SARSteerModel=Kimi-Audio2025.10 | 7.52 | 6.95 | 6.89 | 7.05 | 7.1 | |
| FSDModel=Kimi-Audio2025.10 | 7.21 | 6.62 | 6.66 | 6.82 | 6.83 | |
| AdaShieldModel=Kimi-Audio2025.10 | 7.1 | 6.4 | 6.62 | 6.76 | 6.72 |