Attack Success Rate Evaluation on Hot100
26ASRSkillAttack
Evaluation results
| Method | Links | |
|---|---|---|
| SkillAttackModel=glm-52026.04 | 26 | |
| SkillAttackModel=gpt-5.42026.04 | 23 | |
| SkillAttackModel=hunyuan-2.0-instruct-202511112026.04 | 23 | |
| SkillAttackModel=doubao-seed-1-8-2512282026.04 | 19 | |
| SkillAttackModel=gemini-3.0-pro-preview2026.04 | 16 | |
| SkillAttackModel=kimi-k2.52026.04 | 15 | |
| SkillAttackModel=gpt-5.4-nano2026.04 | 12 | |
| SkillAttackModel=Qwen3.5-Plus2026.04 | 11 | |
| SkillAttackModel=claude-sonnet-4-5-202509292026.04 | 10 | |
| SkillAttackModel=MiniMax-M2.52026.04 | 9 | |
| Direct AttackModel=hunyuan-2.0-instruct-202511112026.04 | 4 | |
| Direct AttackModel=glm-52026.04 | 3 | |
| Direct AttackModel=gpt-5.42026.04 | 2 | |
| Direct AttackModel=kimi-k2.52026.04 | 2 | |
| Direct AttackModel=Qwen3.5-Plus2026.04 | 2 | |
| Direct AttackModel=MiniMax-M2.52026.04 | 2 | |
| Direct AttackModel=doubao-seed-1-8-2512282026.04 | 2 | |
| Direct AttackModel=gpt-5.4-nano2026.04 | 1 | |
| Direct AttackModel=claude-sonnet-4-5-202509292026.04 | 1 | |
| Direct AttackModel=gemini-3.0-pro-preview2026.04 | 1 |