Harmlessness Evaluation on HarmBench
76.6Win Ratefsd-var
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| fsd-varBaseline Model=SFT, Judge Model=GPT-4o-mini2026.03 | 76.6 | 10.6 | 12.7 | |
| fsd-spectral-linearBaseline Model=SFT, Judge Model=GPT-4o-mini2026.03 | 75.3 | 12.3 | 12.4 | |
| fsd-spectral-exponentialBaseline Model=SFT, Judge Model=GPT-4o-mini2026.03 | 74.7 | 12.6 | 12.7 | |
| fsd-cvarBaseline Model=SFT, Judge Model=GPT-4o-mini2026.03 | 72.9 | 15.7 | 11.4 | |
| fsd-spectral-powerBaseline Model=SFT, Judge Model=GPT-4o-mini2026.03 | 71 | 14.8 | 14.1 | |
| Safe RLHFBaseline Model=SFT, Judge Model=GPT-4o-mini2026.03 | 68.1 | 20.4 | 11.5 | |
| fsd-spectral-wangBaseline Model=SFT, Judge Model=GPT-4o-mini2026.03 | 67.3 | 13.4 | 19.3 | |
| fsd-uniformBaseline Model=SFT, Judge Model=GPT-4o-mini2026.03 | 67.1 | 7.8 | 25.1 | |
| fsd-varBaseline Model=Safe RLHF, Judge Model=GPT-4o-mini2026.03 | 39.6 | 28.6 | 31.8 | |
| fsd-uniformBaseline Model=Safe RLHF, Judge Model=GPT-4o-mini2026.03 | 38 | 22.2 | 39.8 | |
| fsd-spectral-linearBaseline Model=Safe RLHF, Judge Model=GPT-4o-mini2026.03 | 34.2 | 37 | 28.9 | |
| fsd-spectral-powerBaseline Model=Safe RLHF, Judge Model=GPT-4o-mini2026.03 | 30.4 | 48.9 | 20.7 | |
| fsd-cvarBaseline Model=Safe RLHF, Judge Model=GPT-4o-mini2026.03 | 28.6 | 46.5 | 24.9 | |
| fsd-spectral-exponentialBaseline Model=Safe RLHF, Judge Model=GPT-4o-mini2026.03 | 28 | 52.2 | 19.9 | |
| fsd-spectral-wangBaseline Model=Safe RLHF, Judge Model=GPT-4o-mini2026.03 | 24.7 | 49.7 | 25.5 |