Toxicity Evaluation on BOLD 23679 prompts (test)
0.02Avg Toxicity (Max)DeStein
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DeSteinBackbone=GPT-2 Large (774M)2026.01 | 0.02 | 0.016 | 7.22 | 0 | |
| RADBackbone=GPT-2 Large (774M), beta (β)=1002026.01 | 0.031 | 0.023 | 5.17 | 0 | |
| RADBackbone=GPT-2 Large (774M), beta (β)=752026.01 | 0.033 | 0.025 | 4.94 | 0 | |
| RADBackbone=GPT-2 Large (774M), beta (β)=3002026.01 | 0.033 | 0.029 | 7.85 | 0 | |
| RADBackbone=GPT-2 Large (774M), beta (β)=502026.01 | 0.035 | 0.026 | 4.83 | 0.1 | |
| RADBackbone=GPT-2 Large (774M), beta (β)=5002026.01 | 0.035 | 0.032 | 9.39 | 0 | |
| TIDEBackbone=GPT-2 Large (774M), # Iterations K=1.022026.01 | 0.038 | 0.03 | 4.77 | 0 | |
| Toxification ReversalBackbone=GPT-2 Large (774M)2026.01 | 0.04 | 0.028 | 7.62 | 0.2 | |
| RADBackbone=GPT-2 Large (774M), beta (β)=102026.01 | 0.047 | 0.034 | 4.75 | 0.3 | |
| GeDiBackbone=GPT-2 Large (774M)2026.01 | 0.051 | 0.036 | 4.89 | 0.6 | |
| DExpertsBackbone=GPT-2 Large (774M)2026.01 | 0.052 | 0.038 | 4.9 | 0.8 | |
| SASABackbone=GPT-2 Large (774M), beta (β)=502026.01 | 0.058 | 0.041 | 4.8 | 1.1 | |
| SASABackbone=GPT-2 Large (774M), beta (β)=3002026.01 | 0.058 | 0.041 | 4.81 | 1.2 | |
| SASABackbone=GPT-2 Large (774M), beta (β)=5002026.01 | 0.058 | 0.041 | 4.81 | 1.1 | |
| Base modelBackbone=GPT-2 Large (774M)2026.01 | 0.059 | 0.042 | 4.8 | 1.4 | |
| SASABackbone=GPT-2 Large (774M), beta (β)=752026.01 | 0.059 | 0.042 | 4.8 | 1.2 | |
| SASABackbone=GPT-2 Large (774M), beta (β)=1002026.01 | 0.059 | 0.041 | 4.81 | 1.3 | |
| SASABackbone=GPT-2 Large (774M), beta (β)=102026.01 | 0.06 | 0.042 | 4.81 | 1.1 |