Jailbreak Attack on AUTORISE Standard
91ASRDeepSeek-V3.2†
Evaluation Results
| Method | Links | |
|---|---|---|
| DeepSeek-V3.2†Model Category=Standard, Evaluation Protocol=Three-judge majority vote, Development Status=AR-Standard dev target, Independent evaluation runs=32026.04 | 91 | |
| GPT-4.1-miniModel Category=Standard, Evaluation Protocol=Three-judge majority vote, Development Status=Held-out, Independent evaluation runs=32026.04 | 88 | |
| GPT-4.1†Model Category=Standard, Evaluation Protocol=Three-judge majority vote, Development Status=AR-Standard dev target, Independent evaluation runs=32026.04 | 87 | |
| Grok 3†Model Category=Standard, Evaluation Protocol=Three-judge majority vote, Development Status=AR-Standard dev target, Independent evaluation runs=32026.04 | 86 | |
| Phi-4-miniModel Category=Standard, Evaluation Protocol=Three-judge majority vote, Development Status=Held-out, Independent evaluation runs=32026.04 | 65 | |
| GPT-4o†Model Category=Standard, Evaluation Protocol=Three-judge majority vote, Development Status=AR-Standard dev target, Independent evaluation runs=32026.04 | 58 | |
| Kimi-K2.5Model Category=Standard, Evaluation Protocol=Three-judge majority vote, Development Status=Held-out, Independent evaluation runs=32026.04 | 23 | |
| Grok 4Model Category=Frontier, Evaluation Protocol=Three-judge majority vote, Development Status=Held-out, Independent evaluation runs=32026.04 | 21 | |
| GPT-5.2Model Category=Frontier, Evaluation Protocol=Three-judge majority vote, Development Status=Held-out, Independent evaluation runs=32026.04 | 3 | |
| GPT-5.4*Model Category=Frontier, Evaluation Protocol=Three-judge majority vote, Development Status=AR-Frontier dev target, Independent evaluation runs=32026.04 | 3 | |
| o4-mini*Model Category=Frontier, Evaluation Protocol=Three-judge majority vote, Development Status=AR-Frontier dev target, Independent evaluation runs=32026.04 | 3 |