Probe Convergence Evaluation on Harmful and Benign Prompts Convergence
100Conv Hbaseline
Evaluation results
| Method | Links | ||
|---|---|---|---|
| baselineModel=Gemma-3-4B2026.05 | 100 | 100 | |
| DPO mix50/1000/augModel=Gemma-3-4B2026.05 | 97.6 | 100 | |
| baselineModel=Mistral-7B2026.05 | 94 | 95.5 | |
| DPO mix50/1000/augModel=Mistral-7B2026.05 | 90 | 90.9 | |
| DPO mix50/1000/augModel=Qwen3-4B2026.05 | 80.8 | 77.3 | |
| baselineModel=Qwen3-4B2026.05 | 78.7 | 63.6 | |
| DPO mix50/1000/augModel=Llama-3.1-8B2026.05 | 73.5 | 65 | |
| DPO mix50/2368/aug ext. pool⋄Model=Qwen2.5-7B2026.05 | 70.2 | 76.1 | |
| baselineModel=Qwen2.5-7B2026.05 | 68.8 | 76.9 | |
| DPO mix50/1000/cleanModel=Qwen2.5-7B2026.05 | 66.7 | 78.6 | |
| baselineModel=Llama-3.1-8B2026.05 | 65.3 | 68.4 | |
| SFT mix0/200/cleanModel=Qwen2.5-7B2026.05 | 60.4 | 66.7 | |
| SFT mix50/200/augModel=Llama-3.1-8B2026.05 | 58 | 80 | |
| SFT mix50/1000/augModel=Qwen3-4B2026.05 | 55.1 | 66.7 | |
| SFT mix50/1000/augModel=Mistral-7B2026.05 | 22 | 4 | |
| SFT mix50/1000/augModel=Gemma-3-4B2026.05 | 6 | 13.3 | |
| Self-ReminderModel=Llama-3.1-8B2026.05 | 0 | 45.5 | |
| Llama-Guard-3Model=Llama-3.1-8B2026.05 | 0 | 50 | |
| Llama-Guard-3Model=Mistral-7B2026.05 | 0 | 100 |