Jailbreak Robustness on HarmBench (Cost & Efficiency Metrics)
0.5AE (Risk/TFLOPs) GCGTulu3 SFT
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Tulu3 SFTModel Family=Tulu3, Size=8B, Training Stage=SFT2026.06 | 0.5 | — | — | 52.4 | 3.5 | 8.9 | 31 | 42 | 50 | |
| Qwen3 4BModel Family=Qwen3, Size=4B2026.06 | 0.9 | — | 31.3 | 21.2 | 16.6 | 22.1 | 36 | 98 | 86 | |
| Tulu3 DPOModel Family=Tulu3, Size=8B, Training Stage=DPO2026.06 | 1 | 521.2 | 79.9 | 40.9 | 6 | 10.4 | 52 | 75 | 67 | |
| Tulu3 RLVRModel Family=Tulu3, Size=8B, Training Stage=RLVR2026.06 | 1 | 503.6 | 72.4 | 25.7 | 6.7 | 18.9 | 54 | 79 | 90 | |
| Qwen2.5 7BModel Family=Qwen2.5, Size=7B, Training Stage=Instruct2026.06 | 1.3 | 399.7 | 38.9 | 22.8 | 13.6 | 23 | 73 | 97 | 94 | |
| Qwen3 4B-SafeRLModel Family=Qwen3, Size=4B, Training Stage=SafeRL2026.06 | 2.1 | 189 | 44.8 | 24.5 | 7.6 | 16 | 67 | 75 | 83 | |
| Qwen2.5 3BModel Family=Qwen2.5, Size=3B, Training Stage=Instruct2026.06 | 3.3 | 173.7 | 33.9 | 13.4 | 15.9 | 36.8 | 81 | 97 | 98 | |
| Qwen3 8BtransferModel Family=Qwen3, Size=8B, Note=GCG transfer from Qwen2.5 0.5B2026.06 | 4.9 | — | — | — | — | — | 15 | — | — | |
| Tulu3 BaseModel Family=Tulu3, Size=8B, Training Stage=Base2026.06 | 8.4 | 59.3 | 11.2 | 9.2 | 39 | 53.3 | 100 | 100 | 100 | |
| Qwen2.5 0.5BModel Family=Qwen2.5, Size=0.5B, Training Stage=Instruct2026.06 | 25.6 | 20 | 15.5 | 8.2 | 30.6 | 59.6 | 99 | 99 | 99 |