Jailbreak Detection on GoalFrameBench (seed prompts)
97AccuracyFrameShield-Last
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FrameShield-LastLLM Backbone=Vicuna-7B2026.02 | 97 | 86 | |
| FrameShield-LastLLM Backbone=Llama3-8B2026.02 | 96 | 86 | |
| FrameShield-LastLLM Backbone=Mistral-7B2026.02 | 92 | 64 | |
| JBShieldLLM Backbone=Vicuna-7B2026.02 | 91 | 91 | |
| JBShieldLLM Backbone=Mistral-7B2026.02 | 88 | 88 | |
| JBShieldLLM Backbone=Qwen3-4B2026.02 | 87 | 88 | |
| FrameShield-LastLLM Backbone=Qwen3-4B2026.02 | 84 | 68 | |
| JBShieldLLM Backbone=Llama3-8B2026.02 | 77 | 86 | |
| LlamaGuardLLM Backbone=Vicuna-7B2026.02 | 75 | 85 | |
| LlamaGuardLLM Backbone=Mistral-7B2026.02 | 74 | 85 | |
| LlamaGuardLLM Backbone=Llama3-8B2026.02 | 60 | 75 | |
| SelfExLLM Backbone=Mistral-7B2026.02 | 46 | 63 | |
| GradSafeLLM Backbone=Llama3-8B2026.02 | 37 | 54 | |
| SelfExLLM Backbone=Llama3-8B2026.02 | 16 | 26 | |
| GradSafeLLM Backbone=Mistral-7B2026.02 | 5 | 10 | |
| GradSafeLLM Backbone=Vicuna-7B2026.02 | 3 | 6 |