Benign Compliance on XSTest
97.6Comply ScoreELS
Evaluation Results
| Method | Links | |
|---|---|---|
| ELSBase Model=Llama-3.1-8B-IT, Input Condition=vani benign2025.10 | 97.6 | |
| Defender-OnlyBase Model=Llama-3.1-8B-IT, Input Condition=vani benign2025.10 | 96.8 | |
| Self-PlayBase Model=Llama-3.1-8B-IT, Input Condition=vani benign2025.10 | 96.4 | |
| Base2026.06 | 95.6 | |
| Llama-3.1-8B-ITModel Status=Base Model, Input Condition=vani benign2025.10 | 94 | |
| SFTBase Model=Llama-3.1-8B-IT, Input Condition=vani benign2025.10 | 94 | |
| Defender-Only + SFTBase Model=Llama-3.1-8B-IT, Input Condition=vani benign2025.10 | 93.2 | |
| Self-Play + SFTBase Model=Llama-3.1-8B-IT, Input Condition=vani benign2025.10 | 92 | |
| AdvGRPO (ST)Attacker=Qwen2.5-14B2026.06 | 91.6 | |
| AdvGRPO (ST)Attacker=Qwen2.5-7B2026.06 | 88.8 | |
| Self-RedTeamAttacker=Qwen2.5-7B2026.06 | 82.8 | |
| AdvGameAttacker=Qwen2.5-7B2026.06 | 81.2 |