Jailbreak Attack Evaluation on S-Eval Aattack
92Attack Success Rate (ASR)Original
Evaluation Results
| Method | Links | |
|---|---|---|
| OriginalModel=Qwen3, Size=8B2026.01 | 92 | |
| OriginalModel=Mistral-v0.3, Size=7B2026.01 | 88 | |
| OriginalModel=Qwen2.5, Size=3B2026.01 | 88 | |
| OriginalModel=Qwen2.5, Size=7B2026.01 | 86 | |
| OriginalModel=Qwen3, Size=14B2026.01 | 86 | |
| OriginalModel=Qwen3, Size=4B2026.01 | 84 | |
| OriginalModel=Phi-3.5, Size=4B2026.01 | 82 | |
| LLM-VAModel=Phi-4, Size=4B2026.01 | 70 | |
| LLM-VAModel=Phi-3.5, Size=4B2026.01 | 66 | |
| OriginalModel=Phi-4, Size=4B2026.01 | 60 | |
| LLM-VAModel=Qwen2.5, Size=7B2026.01 | 54 | |
| OriginalModel=Qwen2.5, Size=14B2026.01 | 46 | |
| LLM-VAModel=Qwen3, Size=4B2026.01 | 46 | |
| LLM-VAModel=Qwen3, Size=14B2026.01 | 46 | |
| LLM-VAModel=Qwen2.5, Size=3B2026.01 | 44 | |
| OriginalModel=gemma-2, Size=9B2026.01 | 42 | |
| LLM-VAModel=Mistral-v0.3, Size=7B2026.01 | 36 | |
| LLM-VAModel=Qwen3, Size=8B2026.01 | 36 | |
| AlphaSteerModel=Mistral-v0.3, Size=7B2026.01 | 34 | |
| AlphaSteerModel=Qwen3, Size=4B2026.01 | 34 | |
| VectorSteerModel=Mistral-v0.3, Size=7B2026.01 | 32 | |
| SCANSModel=Qwen2.5, Size=3B2026.01 | 32 | |
| AlphaSteer+Model=Qwen2.5, Size=7B2026.01 | 32 | |
| SCANSModel=Qwen2.5, Size=7B2026.01 | 30 | |
| SCANSModel=Qwen3, Size=14B2026.01 | 30 | |
| AlphaSteer+Model=Mistral-v0.3, Size=7B2026.01 | 28 | |
| AlphaSteer+Model=Qwen2.5, Size=3B2026.01 | 28 | |
| AlphaSteerModel=Qwen2.5, Size=3B2026.01 | 28 | |
| AlphaSteerModel=Qwen2.5, Size=7B2026.01 | 28 | |
| LLM-VAModel=Qwen2.5, Size=14B2026.01 | 28 | |
| AlphaSteer+Model=Qwen3, Size=4B2026.01 | 28 | |
| SCANSModel=Qwen3, Size=4B2026.01 | 28 | |
| AlphaSteer+Model=Qwen3, Size=14B2026.01 | 28 | |
| SCANSModel=Mistral-v0.3, Size=7B2026.01 | 26 | |
| AlphaSteerModel=Phi-3.5, Size=4B2026.01 | 26 | |
| SCANSModel=Qwen3, Size=8B2026.01 | 26 | |
| AlphaSteerModel=Qwen3, Size=14B2026.01 | 26 | |
| VectorSteerModel=Qwen3, Size=4B2026.01 | 24 | |
| AlphaSteerModel=Qwen3, Size=8B2026.01 | 24 | |
| OriginalModel=Phi-4, Size=15B2026.01 | 22 | |
| VectorSteerModel=Qwen2.5, Size=3B2026.01 | 22 | |
| AlphaSteer+Model=Qwen2.5, Size=14B2026.01 | 22 | |
| VectorSteerModel=Qwen3, Size=8B2026.01 | 22 | |
| VectorSteerModel=Phi-3.5, Size=4B2026.01 | 20 | |
| VectorSteerModel=Phi-4, Size=4B2026.01 | 20 | |
| SCANSModel=Qwen2.5, Size=14B2026.01 | 20 | |
| SCANSModel=gemma-2, Size=9B2026.01 | 18 | |
| AlphaSteer+Model=Phi-3.5, Size=4B2026.01 | 18 | |
| AlphaSteerModel=Phi-4, Size=4B2026.01 | 18 | |
| AlphaSteer+Model=Qwen3, Size=8B2026.01 | 18 | |
| VectorSteerModel=Qwen3, Size=14B2026.01 | 18 | |
| AlphaSteer+Model=gemma-2, Size=9B2026.01 | 16 | |
| AlphaSteerModel=gemma-2, Size=9B2026.01 | 16 | |
| AlphaSteer+Model=Phi-4, Size=4B2026.01 | 16 | |
| VectorSteerModel=Qwen2.5, Size=7B2026.01 | 16 | |
| LLM-VAModel=Llama-3.1, Size=8B2026.01 | 14 | |
| SCANSModel=Phi-4, Size=4B2026.01 | 14 | |
| OriginalModel=Llama-3.1, Size=8B2026.01 | 12 | |
| SCANSModel=Phi-4, Size=15B2026.01 | 12 | |
| LLM-VAModel=Phi-4, Size=15B2026.01 | 12 | |
| VectorSteerModel=gemma-2, Size=9B2026.01 | 10 | |
| AlphaSteer+Model=Phi-4, Size=15B2026.01 | 6 | |
| VectorSteerModel=Qwen2.5, Size=14B2026.01 | 6 | |
| AlphaSteer+Model=Llama-3.1, Size=8B2026.01 | 4 | |
| SCANSModel=Llama-3.1, Size=8B2026.01 | 4 | |
| SCANSModel=Phi-3.5, Size=4B2026.01 | 4 | |
| AlphaSteerModel=Llama-3.1, Size=8B2026.01 | 2 | |
| AlphaSteerModel=Phi-4, Size=15B2026.01 | 2 | |
| VectorSteerModel=Phi-4, Size=15B2026.01 | 2 | |
| AlphaSteerModel=Qwen2.5, Size=14B2026.01 | 2 | |
| VectorSteerModel=Llama-3.1, Size=8B2026.01 | 0 | |
| LLM-VAModel=gemma-2, Size=9B2026.01 | 0 |