Safety Behavior Evaluation on Safety evaluation suite
16.5ASR+ Safety 40k
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| + Safety 40kSFT training data category=Trained on general SFT data + safety SFT data2026.05 | 16.5 | 43 | 70.25 | |
| + Safety 4k + Random synth 4kSFT training data category=Trained on general SFT data + safety SFT data + SAE synthetic data2026.05 | 20 | 36 | 72 | |
| + Safety 120kSFT training data category=Trained on general SFT data + safety SFT data2026.05 | 21 | 21.5 | 78.75 | |
| + Safety 8kSFT training data category=Trained on general SFT data + safety SFT data2026.05 | 22 | 34.5 | 71.75 | |
| + Safety 200kSFT training data category=Trained on general SFT data + safety SFT data2026.05 | 24 | 19 | 78.5 | |
| + Safety 4k + Feature synth 4kSFT training data category=Trained on general SFT data + safety SFT data + SAE synthetic data2026.05 | 24 | 20.5 | 77.75 | |
| Alpaca 50kSFT training data category=Trained on general SFT data only2026.05 | 73 | 3.5 | 61.75 |