Detoxification on AttaQ benchmark
0.045Avg Toxicity (Max)RAD
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| RADBase Model=GPT-2 Large (774M), Temperature=0.1, Trials=3, Beta (β)=5002026.01 | 0.045 | 0.039 | 18.2 | 0 | — | |
| RADBeta (β)=500, Base Model=Llama 3.1-8B2026.01 | 0.045 | 0.037 | 19.88 | 0 | — | |
| DeSteinBase Model=GPT-2 Large (774M), Temperature=0.1, Trials=32026.01 | 0.055 | 0.037 | 5.77 | 0.8 | — | |
| RADBase Model=GPT-2 Large (774M), Temperature=0.1, Trials=3, Beta (β)=3002026.01 | 0.057 | 0.044 | 10.22 | 0.9 | — | |
| RADBeta (β)=300, Base Model=Llama 3.1-8B2026.01 | 0.061 | 0.048 | 9.7 | 0.6 | — | |
| RADBase Model=GPT-2 Large (774M), Temperature=0.1, Trials=3, Beta (β)=1002026.01 | 0.089 | 0.066 | 3.98 | 0.5 | — | |
| RADBase Model=GPT-2 Large (774M), Temperature=0.1, Trials=3, Beta (β)=752026.01 | 0.099 | 0.074 | 3.71 | 0.7 | — | |
| TIDEBase Model=GPT-2 Large (774M), Temperature=0.1, Trials=32026.01 | 0.108 | 0.088 | 3.44 | 0 | 1.11 | |
| Toxification ReversalBase Model=GPT-2 Large (774M), Temperature=0.1, Trials=32026.01 | 0.11 | 0.075 | 4.74 | 2.8 | — | |
| RADBeta (β)=100, Base Model=Llama 3.1-8B2026.01 | 0.113 | 0.085 | 3.92 | 1.9 | — | |
| RADBase Model=GPT-2 Large (774M), Temperature=0.1, Trials=3, Beta (β)=502026.01 | 0.117 | 0.088 | 3.51 | 1.5 | — | |
| RADBeta (β)=75, Base Model=Llama 3.1-8B2026.01 | 0.125 | 0.093 | 3.63 | 2.1 | — | |
| TIDEBase Model=Llama 3.1-8B, # Iterations K̄=1.142026.01 | 0.138 | 0.112 | 3.2 | 0.1 | — | |
| RADBeta (β)=50, Base Model=Llama 3.1-8B2026.01 | 0.146 | 0.107 | 3.35 | 3 | — | |
| GeDiBase Model=GPT-2 Large (774M), Temperature=0.1, Trials=32026.01 | 0.155 | 0.116 | 3.54 | 4.5 | — | |
| RADBase Model=GPT-2 Large (774M), Temperature=0.1, Trials=3, Beta (β)=102026.01 | 0.156 | 0.117 | 3.38 | 4.5 | — | |
| DExpertsBase Model=GPT-2 Large (774M), Temperature=0.1, Trials=32026.01 | 0.165 | 0.125 | 3.38 | 5.7 | — | |
| SASABeta (β)=500, Base Model=Llama 3.1-8B2026.01 | 0.169 | 0.131 | 5.17 | 6 | — | |
| SASABase Model=GPT-2 Large (774M), Temperature=0.1, Trials=3, Beta (β)=3002026.01 | 0.173 | 0.131 | 3.35 | 6.5 | — | |
| SASABase Model=GPT-2 Large (774M), Temperature=0.1, Trials=3, Beta (β)=5002026.01 | 0.173 | 0.13 | 3.37 | 6.2 | — | |
| SASABase Model=GPT-2 Large (774M), Temperature=0.1, Trials=3, Beta (β)=102026.01 | 0.174 | 0.131 | 3.34 | 6.4 | — | |
| SASABase Model=GPT-2 Large (774M), Temperature=0.1, Trials=3, Beta (β)=502026.01 | 0.174 | 0.132 | 3.35 | 6.5 | — | |
| SASABase Model=GPT-2 Large (774M), Temperature=0.1, Trials=3, Beta (β)=1002026.01 | 0.174 | 0.132 | 3.35 | 6.3 | — | |
| SASABase Model=GPT-2 Large (774M), Temperature=0.1, Trials=3, Beta (β)=752026.01 | 0.176 | 0.133 | 3.35 | 6.5 | — | |
| Base modelBase Model=GPT-2 Large (774M), Temperature=0.1, Trials=32026.01 | 0.179 | 0.134 | 3.36 | 7.2 | — | |
| SASABeta (β)=300, Base Model=Llama 3.1-8B2026.01 | 0.189 | 0.145 | 3.49 | 6.9 | — | |
| RADBeta (β)=10, Base Model=Llama 3.1-8B2026.01 | 0.192 | 0.145 | 3.1 | 6.5 | — | |
| SASABeta (β)=50, Base Model=Llama 3.1-8B2026.01 | 0.212 | 0.161 | 3.09 | 9.3 | — | |
| SASABeta (β)=100, Base Model=Llama 3.1-8B2026.01 | 0.212 | 0.16 | 3.1 | 9.2 | — | |
| SASABeta (β)=75, Base Model=Llama 3.1-8B2026.01 | 0.215 | 0.163 | 3.08 | 10 | — | |
| SASABeta (β)=10, Base Model=Llama 3.1-8B2026.01 | 0.221 | 0.166 | 3.08 | 10.1 | — | |
| Base modelBase Model=Llama 3.1-8B, Temperature=0.1, Number of trials=32026.01 | 0.222 | 0.166 | 3.11 | 10.1 | — |