Safety Evaluation on XSTest (Comprehensive Metrics)
92Compliance (Safe)SFT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SFTTraining configuration=SFT2026.06 | 92 | 8 | 0.8 | 73.9 | 22.6 | 82.9 | 81.9 | |
| 3-level (lin.)Training configuration=3-level (lin.)2026.06 | 83.1 | 16.9 | 6.9 | 83.3 | 11.6 | 83.2 | 83.2 | |
| baselineTraining configuration=baseline2026.06 | 80.6 | 19.4 | 2.4 | 81.5 | 17.4 | 81.1 | 81.1 | |
| GW-DPO (bi.)Training configuration=GW-DPO (bi.)2026.06 | 55.6 | 44.4 | 18.4 | 91 | 6.9 | 73.3 | 69 | |
| GW-DPO (lin.)Training configuration=GW-DPO (lin.)2026.06 | 53.5 | 46.5 | 6.1 | 97 | 2.5 | 75.2 | 68.9 | |
| DPOTraining configuration=DPO2026.06 | 41.2 | 58.8 | 4.8 | 99 | 0.5 | 70.1 | 58.2 | |
| No-ISETraining configuration=No-ISE2026.06 | 26.5 | 73.5 | 6 | 100 | 0 | 63.3 | 41.9 |