Jailbreak Attack on Behaviours
0.9ASRPRO-VICUNA-HUBER
Evaluation results
| Method | Links | |
|---|---|---|
| PRO-VICUNA-HUBERSmooth q=1, delta=0.1, Smoothing Type=Patch2024.10 | 0.9 | |
| PRO-VICUNA-HUBERSmooth q=3, delta=0.1, Smoothing Type=Patch2024.10 | 0.9 | |
| PRO-VICUNA-HUBERSmooth q=5, delta=0.1, Smoothing Type=Patch2024.10 | 0.9 | |
| PRO-VICUNA-HUBERSmooth q=10, delta=0.1, Smoothing Type=Patch2024.10 | 0.9 | |
| PRO-VICUNA-HUBERSmooth q=15, delta=0.1, Smoothing Type=Patch2024.10 | 0.9 | |
| PRO-VICUNA-HUBERSmoothing Type=Insert, delta (δ)=0.1, Smooth q=12024.10 | 0.9 | |
| PRO-VICUNA-HUBERSmoothing Type=Insert, delta (δ)=0.1, Smooth q=32024.10 | 0.9 | |
| PRO-VICUNA-HUBERSmoothing Type=Insert, delta (δ)=0.1, Smooth q=52024.10 | 0.9 | |
| PRO-VICUNA-HUBERSmoothing Type=Insert, delta (δ)=0.1, Smooth q=102024.10 | 0.9 | |
| PRO-VICUNA-HUBERSmoothing Type=Insert, delta (δ)=0.1, Smooth q=152024.10 | 0.9 | |
| PRO-VICUNA-HUBERSmooth q=0, delta=0.1, Smoothing Type=Patch2024.10 | 1.8 | |
| VICUNASmoothing Type=Insert, Smooth q=152024.10 | 1.8 | |
| PRO-VICUNA-HUBERSmoothing Type=Insert, delta (δ)=0.1, Smooth q=02024.10 | 1.8 | |
| VICUNASmoothing Type=Insert, Smooth q=102024.10 | 4.5 | |
| VICUNASmoothing Type=Insert, Smooth q=52024.10 | 10.9 | |
| VicunaSmooth q=15, Smoothing Type=Patch2024.10 | 14.5 | |
| VicunaSmooth q=10, Smoothing Type=Patch2024.10 | 21.8 | |
| VicunaSmooth q=5, Smoothing Type=Patch2024.10 | 39.1 | |
| VICUNASmoothing Type=Insert, Smooth q=32024.10 | 44.5 | |
| Pro-Vicuna (Best)Num of attack queries=122024.10 | 50.7 | |
| Pro-Vicuna-Huber δ = 0.7Num of attack queries=122024.10 | 50.7 | |
| Pro-Vicuna (Best)Num of attack queries=132024.10 | 55.9 | |
| Pro-Vicuna-Huber δ = 0.7Num of attack queries=132024.10 | 55.9 | |
| VicunaSmooth q=3, Smoothing Type=Patch2024.10 | 57.3 | |
| Pro-Vicuna-Huber δ = 0.3Num of attack queries=122024.10 | 60.2 | |
| Pro-Vicuna-Huber δ = 0.3Num of attack queries=132024.10 | 60.2 | |
| Pro-Vicuna (Best)Num of attack queries=142024.10 | 60.8 | |
| Pro-Vicuna-Huber δ = 0.5Num of attack queries=122024.10 | 60.8 | |
| Pro-Vicuna-Huber δ = 0.7Num of attack queries=142024.10 | 60.8 | |
| VicunaNum of attack queries=122024.10 | 61.4 | |
| Pro-Vicuna-Huber δ = 0.5Num of attack queries=132024.10 | 61.8 | |
| Pro-Vicuna-Huber δ = 0.5Num of attack queries=142024.10 | 62.7 | |
| Pro-Vicuna (Best)Num of attack queries=152024.10 | 64.3 | |
| Pro-Vicuna-Huber δ = 0.7Num of attack queries=152024.10 | 64.3 | |
| Pro-Vicuna-Huber δ = 0.3Num of attack queries=142024.10 | 65 | |
| VicunaNum of attack queries=132024.10 | 65.2 | |
| Pro-Vicuna-Huber δ = 0.5Num of attack queries=152024.10 | 66.7 | |
| Pro-Vicuna (Best)Num of attack queries=162024.10 | 67.4 | |
| Pro-Vicuna-Huber δ = 0.7Num of attack queries=162024.10 | 67.4 | |
| Pro-Vicuna-Huber δ = 0.5Num of attack queries=162024.10 | 67.6 | |
| Pro-Vicuna (Best)Num of attack queries=172024.10 | 70.5 | |
| Pro-Vicuna-Huber δ = 0.7Num of attack queries=172024.10 | 70.5 | |
| Pro-Vicuna-Huber δ = 0.3Num of attack queries=152024.10 | 70.9 | |
| VicunaNum of attack queries=142024.10 | 71.5 | |
| Pro-Vicuna-Huber δ = 0.5Num of attack queries=172024.10 | 71.6 | |
| VicunaSmooth q=1, Smoothing Type=Patch2024.10 | 71.8 | |
| Pro-Vicuna-Huber δ = 0.3Num of attack queries=162024.10 | 72.8 | |
| Pro-Vicuna (Best)Num of attack queries=182024.10 | 74 | |
| Pro-Vicuna-Huber δ = 0.7Num of attack queries=182024.10 | 74 | |
| Pro-Vicuna-Huber δ = 0.3Num of attack queries=172024.10 | 75.7 | |
| VicunaNum of attack queries=152024.10 | 75.8 | |
| Pro-Vicuna (Best)Num of attack queries=192024.10 | 77.7 | |
| Pro-Vicuna-Huber δ = 0.3Num of attack queries=182024.10 | 77.7 | |
| Pro-Vicuna-Huber δ = 0.3Num of attack queries=192024.10 | 77.7 | |
| Pro-Vicuna-Huber δ = 0.5Num of attack queries=182024.10 | 78.4 | |
| Pro-Vicuna (Best)Num of attack queries=202024.10 | 78.6 | |
| Pro-Vicuna-Huber δ = 0.3Num of attack queries=202024.10 | 78.6 | |
| VicunaNum of attack queries=162024.10 | 78.7 | |
| VICUNASmoothing Type=Insert, Smooth q=12024.10 | 79.1 | |
| Pro-Vicuna-Huber δ = 0.7Num of attack queries=192024.10 | 79.7 | |
| Pro-Vicuna-Huber δ = 0.5Num of attack queries=192024.10 | 81.4 | |
| Pro-Vicuna-Huber δ = 0.5Num of attack queries=202024.10 | 82.4 | |
| Pro-Vicuna-Huber δ = 0.7Num of attack queries=202024.10 | 82.4 | |
| VicunaNum of attack queries=172024.10 | 82.6 | |
| VicunaNum of attack queries=182024.10 | 84.1 | |
| VicunaNum of attack queries=192024.10 | 86.5 | |
| VicunaNum of attack queries=202024.10 | 87.4 | |
| VicunaSmooth q=0, Smoothing Type=Patch2024.10 | 91.8 | |
| VICUNASmoothing Type=Insert, Smooth q=02024.10 | 91.8 |