Language model detoxification on RealToxicityPrompts (test)
91.3Distinct-1TruthFlow
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| TruthFlowModel=Mistral-7B2026.02 | 91.3 | — | — | — | 99.1 | 99.5 | |
| Linear-AcTModel=Qwen2.5-7B2026.02 | 91.2 | — | — | — | 99.3 | 99.8 | |
| HPRModel=LLaMA3.1-8B2026.02 | 91.1 | — | — | — | 99.3 | 99.8 | |
| OriginalModel=Qwen2.5-7B2026.02 | 91 | — | — | — | 99.2 | 99.7 | |
| CAAModel=Qwen2.5-7B2026.02 | 91 | — | — | — | 99.1 | 99.6 | |
| HPRModel=Qwen2.5-7B2026.02 | 91 | — | — | — | 99.1 | 99.6 | |
| OriginalModel=LLaMA3.1-8B2026.02 | 90.9 | — | — | — | 99.1 | 99.7 | |
| RE-ControlModel=LLaMA3.1-8B2026.02 | 90.9 | — | — | — | 99.2 | 99.7 | |
| MiMiCModel=Qwen2.5-7B2026.02 | 90.9 | — | — | — | 99.1 | 99.6 | |
| MiMiCModel=LLaMA3.1-8B2026.02 | 90.8 | — | — | — | 99.2 | 99.8 | |
| Linear-AcTModel=Mistral-7B2026.02 | 90.7 | — | — | — | 99.1 | 99.7 | |
| CAAModel=LLaMA3.1-8B2026.02 | 90.7 | — | — | — | 99.1 | 99.6 | |
| Linear-AcTModel=LLaMA3.1-8B2026.02 | 90.7 | — | — | — | 99.1 | 99.7 | |
| CAAModel=Mistral-7B2026.02 | 90.6 | — | — | — | 99.1 | 99.7 | |
| MiMiCModel=Mistral-7B2026.02 | 90.6 | — | — | — | 99.1 | 99.7 | |
| RepEModel=LLaMA3.1-8B2026.02 | 90.6 | — | — | — | 99.1 | 99.7 | |
| ITIModel=LLaMA3.1-8B2026.02 | 90.6 | — | — | — | 99.1 | 99.7 | |
| ODESTEERModel=Qwen2.5-7B2026.02 | 90.6 | — | — | — | 99.2 | 99.7 | |
| OriginalModel=Mistral-7B2026.02 | 90.5 | — | — | — | 99.1 | 99.7 | |
| ODESTEERModel=Mistral-7B2026.02 | 90.5 | — | — | — | 99.3 | 99.8 | |
| TruthFlowModel=LLaMA3.1-8B2026.02 | 90.5 | — | — | — | 99.2 | 99.8 | |
| ODESTEERModel=LLaMA3.1-8B2026.02 | 90.5 | — | — | — | 99.3 | 99.8 | |
| RE-ControlModel=Qwen2.5-7B2026.02 | 90.2 | — | — | — | 98.8 | 99.5 | |
| ITIModel=Mistral-7B2026.02 | 90.1 | — | — | — | 98.9 | 99.6 | |
| RE-ControlModel=Mistral-7B2026.02 | 90.1 | — | — | — | 98.9 | 99.6 | |
| ITIModel=Qwen2.5-7B2026.02 | 89.4 | — | — | — | 98.4 | 99.3 | |
| RepEModel=Qwen2.5-7B2026.02 | 87.8 | — | — | — | 96.1 | 97.6 | |
| HPRModel=Mistral-7B2026.02 | 87.1 | — | — | — | 97.5 | 98.8 | |
| TruthFlowModel=Qwen2.5-7B2026.02 | 86.6 | — | — | — | 97.7 | 98.9 | |
| OriginalModel=Falcon-7B2026.02 | 81 | — | — | — | 94.8 | 97.2 | |
| CAAModel=Falcon-7B2026.02 | 81 | — | — | — | 95 | 97.4 | |
| Linear-AcTModel=Falcon-7B2026.02 | 81 | — | — | — | 94.9 | 97.2 | |
| RE-ControlModel=Falcon-7B2026.02 | 80.2 | — | — | — | 94.1 | 96.4 | |
| MiMiCModel=Falcon-7B2026.02 | 80.1 | — | — | — | 94.1 | 96.7 | |
| ODESTEERModel=Falcon-7B2026.02 | 79.8 | — | — | — | 94.4 | 96.9 | |
| RepEModel=Falcon-7B2026.02 | 79.7 | — | — | — | 94 | 96.6 | |
| ITIModel=Falcon-7B2026.02 | 79.6 | — | — | — | 93.5 | 96 | |
| RepEModel=Mistral-7B2026.02 | 77.4 | — | — | — | 96.9 | 99.4 | |
| TruthFlowModel=Falcon-7B2026.02 | 76.9 | — | — | — | 91 | 94.2 | |
| HPRModel=Falcon-7B2026.02 | 76.8 | — | — | — | 91.9 | 95 | |
| GeDiBackbone Size=1.5B2023.05 | 62 | 0.363 | 0.217 | 60.03 | 84 | 83 | |
| GPT-2 (original)Backbone Size=117M2023.05 | 58 | 0.527 | 0.52 | 25.45 | 85 | 85 | |
| PPLM (10%)Backbone Size=345M2023.05 | 58 | 0.52 | 0.518 | 32.58 | 86 | 86 | |
| DExperts-largeBackbone Size=762M2023.05 | 58 | 0.314 | 0.128 | 32.41 | 84 | 84 | |
| PromptT5Backbone Size=780M2023.05 | 58 | 0.32 | 0.172 | 55.1 | 76 | 70 | |
| DAPTBackbone Size=117M2023.05 | 57 | 0.428 | 0.36 | 31.21 | 84 | 84 | |
| DExperts-mediumBackbone Size=345M2023.05 | 57 | 0.307 | 0.125 | 32.51 | 84 | 84 | |
| DExperts-baseBackbone Size=117M2023.05 | 56 | 0.302 | 0.118 | 38.2 | 82 | 83 | |
| LM-Steer-mediumBackbone Size=345M2023.05 | 56 | 0.215 | 0.059 | 43.56 | 83 | 84 | |
| MuCoLaBackbone Size=762M2023.05 | 55 | 0.308 | 0.088 | 29.92 | 82 | 83 | |
| LM-Steer-largeBackbone Size=762M2023.05 | 55 | 0.249 | 0.089 | 28.26 | 84 | 84 | |
| LM-Steer-baseBackbone Size=117M2023.05 | 54 | 0.296 | 0.129 | 36.87 | 86 | 86 | |
| LORABackbone Size=762M2023.05 | 53 | 0.365 | 0.21 | 21.11 | 85 | 86 | |
| Soft-BlacklistBackbone Size=762M2023.05 | 53 | 0.27 | 0.154 | 18.28 | 81 | 83 |