Jailbreak Attack Defense on Adversarial Jailbreak Prompts
63ATTEN ScoreSpecreason
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SpecreasonModel=Qwen3-32B (Draft: 1.7B)2026.06 | 63 | 66 | 55 | 69 | 76 | 59 | 84 | 67 | |
| Specreason+RPOModel=DeepSeek-70B (Draft: 8B)2026.06 | 61 | 39 | 12 | 8 | 38 | 54 | 54 | 38 | |
| SpecreasonModel=DeepSeek-70B (Draft: 8B)2026.06 | 56 | 65 | 17 | 66 | 45 | 77 | 74 | 57 | |
| No DefenseModel=Qwen3-32B (Draft: 1.7B)2026.06 | 55 | 64 | 62 | 70 | 62 | 57 | 86 | 65 | |
| Spec-DecodingModel=Qwen3-32B (Draft: 1.7B)2026.06 | 55 | 63 | 61 | 69 | 63 | 57 | 88 | 65 | |
| SecDecodingModel=DeepSeek-70B (Draft: 8B)2026.06 | 53 | 63 | 15 | 57 | 46 | 74 | 66 | 53 | |
| Spec-DecodingModel=DeepSeek-70B (Draft: 8B)2026.06 | 50 | 56 | 18 | 63 | 41 | 77 | 48 | 50 | |
| No DefenseModel=DeepSeek-70B (Draft: 8B)2026.06 | 48 | 57 | 19 | 62 | 42 | 80 | 46 | 51 | |
| SafeDecodingModel=Qwen3-32B (Draft: 1.7B)2026.06 | 46 | 5 | 44 | 35 | 0 | 13 | 80 | 32 | |
| RPOModel=Qwen3-32B (Draft: 1.7B)2026.06 | 35 | 17 | 12 | 32 | 31 | 57 | 38 | 31 | |
| RPOModel=DeepSeek-70B (Draft: 8B)2026.06 | 35 | 46 | 11 | 43 | 37 | 72 | 26 | 39 | |
| Specreason+RPOModel=Qwen3-32B (Draft: 1.7B)2026.06 | 32 | 28 | 7 | 23 | 41 | 26 | 62 | 31 | |
| Specreason+SRModel=DeepSeek-70B (Draft: 8B)2026.06 | 32 | 53 | 3 | 24 | 21 | 71 | 38 | 35 | |
| SRModel=DeepSeek-70B (Draft: 8B)2026.06 | 17 | 34 | 0 | 25 | 5 | 66 | 16 | 23 | |
| Specreason+SRModel=Qwen3-32B (Draft: 1.7B)2026.06 | 14 | 42 | 5 | 37 | 29 | 47 | 62 | 34 | |
| SRModel=Qwen3-32B (Draft: 1.7B)2026.06 | 9 | 31 | 6 | 32 | 26 | 52 | 68 | 31 | |
| SafeSpecModel=DeepSeek-70B (Draft: 8B)2026.06 | 9 | 14 | 0 | 2 | 9 | 7 | 6 | 7 | |
| SecDecodingModel=Qwen3-32B (Draft: 1.7B)2026.06 | 6 | 6 | 57 | 15 | 4 | 6 | 62 | 22 | |
| SafeSpecModel=Qwen3-32B (Draft: 1.7B)2026.06 | 5 | 10 | 4 | 1 | 13 | 9 | 8 | 7 | |
| SafeDecodingModel=DeepSeek-70B (Draft: 8B)2026.06 | 0 | 28 | 0 | 0 | 2 | 0 | 30 | 9 |