Jailbreak Detection on Full Evaluation Benchmark (~14.4k conversations) (test)
92.1RecallTurnEncoder–ConvTransformer
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TurnEncoder–ConvTransformerclassification threshold (τ)=0.502026.06 | 92.1 | 95.9 | 93.94 | 2.8 | |
| Claude Opus 4.72026.06 | 78.3 | 90.6 | 86.91 | 5.8 | |
| Claude Sonnet 4.52026.06 | 66.1 | 91.7 | 76.82 | 4.3 | |
| Claude Sonnet 42026.06 | 59.1 | 91.7 | 71.89 | 3.8 | |
| ToT ORBackbone=Llama 3.3 70B2026.06 | 47.1 | 85.3 | 60.72 | 5.8 | |
| ToT MajorityBackbone=Llama 3.3 70B2026.06 | 37 | 89.1 | 52.26 | 3.2 | |
| ConcatenationBackbone=Llama 3.3 70B2026.06 | 36.2 | 88.5 | 51.36 | 3.4 |