Content Moderation on Safety Evaluation Set Moderation (held-out target labels)
0.89AUROCSafety Monitor (In-model)
Evaluation results
| Method | Links | |
|---|---|---|
| Safety Monitor (In-model)Model=Qwen-2.5-7B-Instruct2026.05 | 0.89 | |
| Quotient TransferTarget Model=Qwen-2.5-Coder-7B, Source Model=Qwen-2.5-7B-Instruct2026.05 | 0.867 | |
| Quotient TransferTarget Model=Qwen-14B, Source Model=Qwen-2.5-7B-Instruct2026.05 | 0.857 | |
| Quotient TransferTarget Model=Qwen-3B, Source Model=Qwen-2.5-7B-Instruct2026.05 | 0.836 | |
| Quotient TransferTarget Model=Mistral, Source Model=Qwen-2.5-7B-Instruct2026.05 | 0.82 | |
| Random-initialization control2026.05 | 0.512 |