Jailbreak Detection on Jailbreak Detection Evaluation Set (combined)
0.895AccuracyKCD
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| KCDLayer=21, Target Model=InternVL3-8B2025.12 | 0.895 | 0.975 | 0.155 | 0.9 | 0.926 | 0.924 | |
| MCDLayer=21, Target Model=InternVL3-8B2025.12 | 0.891 | 0.952 | 0.17 | 0.892 | 0.962 | 0.96 | |
| MCDLayer=20, Target Model=InternVL3-8B2025.12 | 0.887 | 0.975 | 0.201 | 0.891 | 0.95 | 0.94 | |
| KCDLayer=22, Target Model=InternVL3-8B2025.12 | 0.884 | 0.976 | 0.208 | 0.922 | 0.925 | 0.922 | |
| MCDLayer=22, Target Model=InternVL3-8B2025.12 | 0.88 | 0.96 | 0.2 | 0.916 | 0.96 | 0.959 | |
| KCDLayer=20, Target Model=InternVL3-8B2025.12 | 0.877 | 0.97 | 0.216 | 0.898 | 0.93 | 0.929 | |
| JailDAM (RCS)Layer=CLIP, Target Model=Target Model-Agnostic2025.12 | 0.845 | 0.934 | 0.244 | 0.858 | 0.915 | 0.9 | |
| JailDAM (Original)Layer=CLIP, Target Model=Target Model-Agnostic2025.12 | 0.717 | 0.706 | 0.271 | 0.714 | 0.789 | 0.826 | |
| JailGuardLayer=Output, Target Model=InternVL3-8B2025.12 | 0.692 | 0.6 | 0.216 | 0.661 | 0.762 | 0.775 | |
| GradSafeLayer=Critical Param., Target Model=InternVL3-8B2025.12 | 0.691 | 0.929 | 0.547 | 0.749 | 0.802 | 0.795 | |
| HiddenDetectLayer=18–24, Target Model=InternVL3-8B2025.12 | 0.625 | 0.687 | 0.571 | 0.812 | 0.759 | 0.784 | |
| K-MeansLayer=FLAVA, Target Model=Target Model-Agnostic2025.12 | 0.623 | 0.974 | 0.729 | 0.721 | 0.598 | 0.62 | |
| LogisticLayer=FLAVA, Target Model=Target Model-Agnostic2025.12 | 0.598 | 0.376 | 0.18 | 0.483 | 0.617 | 0.668 |