Safety Classification on Pre-Ex-Bench
94.01AccuracyTRACE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TRACEBackbone=Llama-3.1-8B2026.05 | 94.01 | 92.13 | 88.79 | |
| TRACEBackbone=Qwen3-4B-Instruct-25072026.05 | 93.88 | 92.23 | 91.13 | |
| TRACEBackbone=Qwen3Guard-Gen-4B2026.05 | 93.62 | 91.55 | 88.59 | |
| TRACEBackbone=Qwen3-8B2026.05 | 92.06 | 89.69 | 89.27 | |
| MAGEBackbone=Qwen3-8B2026.05 | 90.87 | 88.35 | 85.21 | |
| SFTBackbone=Qwen3-8B2026.05 | 90.49 | 87.29 | 83.06 | |
| MAGEBackbone=Qwen3-4B-Instruct-25072026.05 | 88.52 | 85.74 | 66.09 | |
| SFTBackbone=Qwen3-4B-Instruct-25072026.05 | 86.91 | 83.81 | 81.07 | |
| MAGEBackbone=Llama-3.1-8B2026.05 | 81.89 | 72.34 | 71.28 | |
| MAGEBackbone=Qwen3Guard-Gen-4B2026.05 | 81.05 | 57.82 | 52.41 | |
| SFTBackbone=Llama-3.1-8B2026.05 | 79.39 | 64.96 | 56.99 | |
| SFTBackbone=Qwen3Guard-Gen-4B2026.05 | 79.03 | 56.32 | 50.38 | |
| AABackbone=Llama-3.1-8B2026.05 | 70.42 | 68.42 | 67.25 | |
| AABackbone=Qwen3-8B2026.05 | 69.84 | 40.79 | 29.25 | |
| BaseBackbone=Llama-3.1-8B2026.05 | 62.2 | 16.84 | 10.54 | |
| AABackbone=Qwen3-4B-Instruct-25072026.05 | 60.56 | 53.87 | 45.45 | |
| BaseBackbone=Qwen3-8B2026.05 | 60.53 | 15.44 | 12.83 | |
| BaseBackbone=Qwen3Guard-Gen-4B2026.05 | 60.47 | 10.51 | 13.43 | |
| AABackbone=Qwen3Guard-Gen-4B2026.05 | 59.77 | 52.97 | 41.6 | |
| BaseBackbone=Qwen3-4B-Instruct-25072026.05 | 59.7 | 53.39 | 58.96 |