Detoxification Evaluation on Detoxification dataset
19.07Toxicity ScorePalette w/ LaPA²
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Palette w/ LaPA²Backbone=Pythia 12B, Length=642025.08 | 19.07 | 186.03 | 1 | 18 | 49 | |
| DATGBackbone=Pythia 12B, Length=642025.08 | 19.96 | 7.87 | 1 | 10 | 17 | |
| PaletteBackbone=Pythia 12B, Length=642025.08 | 22.04 | 132.78 | 1 | 17 | 43 | |
| PREADD w/ LaPA²Backbone=LLaMA-2 7B, Length=5122025.08 | 27.32 | 5.99 | 2 | 39 | 68 | |
| PREADD w/ LaPA²Backbone=LLaMA-2 7B, Length=642025.08 | 27.84 | 27.93 | 9 | 55 | 82 | |
| PREADDBackbone=LLaMA-2 7B, Length=5122025.08 | 27.96 | 11.34 | 2 | 35 | 71 | |
| PREADDBackbone=LLaMA-2 7B, Length=642025.08 | 29.72 | 31.98 | 9 | 52 | 81 | |
| PREADD w/ LaPA²Backbone=LLaMA-2 13B, Length=5122025.08 | 32.61 | 4.81 | 2 | 39 | 70 | |
| PREADD w/ LaPA²Backbone=LLaMA-2 13B, Length=642025.08 | 33.33 | 22.09 | 9 | 54 | 80 | |
| DATGBackbone=LLaMA-2 7B, Length=642025.08 | 33.34 | 52.12 | 7 | 43 | 75 | |
| PREADDBackbone=LLaMA-2 13B, Length=5122025.08 | 33.34 | 8.83 | 2 | 35 | 71 | |
| NegPrompt w/ LaPA²Backbone=LLaMA-2 13B, Length=5122025.08 | 33.7 | 28.43 | 2 | 33 | 72 | |
| DATGBackbone=LLaMA-2 7B, Length=5122025.08 | 33.84 | 19.96 | 2 | 28 | 62 | |
| PREADDBackbone=LLaMA-2 13B, Length=642025.08 | 34.8 | 25.38 | 9 | 52 | 80 | |
| DATGBackbone=LLaMA-2 13B, Length=5122025.08 | 35.08 | 17.72 | 2 | 29 | 64 | |
| NegPrompt w/ LaPA²Backbone=LLaMA-2 13B, Length=642025.08 | 35.12 | 41.18 | 8 | 50 | 81 | |
| PREADD w/ LaPA²Backbone=Pythia 12B, Length=642025.08 | 35.46 | 31.13 | 8 | 48 | 75 | |
| PREADD w/ LaPA²Backbone=Pythia 12B, Length=5122025.08 | 35.62 | 7.02 | 2 | 35 | 64 | |
| NegPrompt w/ LaPA²Backbone=LLaMA-2 7B, Length=5122025.08 | 35.82 | 32.56 | 2 | 32 | 69 | |
| DATGBackbone=LLaMA-2 13B, Length=642025.08 | 36 | 44.59 | 7 | 44 | 75 | |
| PREADDBackbone=Pythia 12B, Length=642025.08 | 36.23 | 31.35 | 7 | 46 | 74 | |
| NegPromptBackbone=LLaMA-2 13B, Length=5122025.08 | 36.52 | 10.5 | 2 | 34 | 71 | |
| PREADDBackbone=Pythia 12B, Length=5122025.08 | 36.63 | 10.66 | 2 | 30 | 63 | |
| NegPrompt w/ LaPA²Backbone=LLaMA-2 7B, Length=642025.08 | 37.17 | 60.82 | 8 | 50 | 80 | |
| NegPromptBackbone=LLaMA-2 7B, Length=5122025.08 | 37.55 | 12.77 | 2 | 33 | 69 | |
| NegPromptBackbone=LLaMA-2 13B, Length=642025.08 | 38.17 | 30.01 | 8 | 49 | 79 | |
| Palette w/ LaPA²Backbone=LLaMA-2 7B, Length=5122025.08 | 38.69 | 22.9 | 1 | 12 | 36 | |
| Palette w/ LaPA²Backbone=LLaMA-2 13B, Length=5122025.08 | 38.84 | 29.71 | 2 | 12 | 34 | |
| NegPromptBackbone=LLaMA-2 7B, Length=642025.08 | 39.29 | 34.13 | 8 | 49 | 79 | |
| NegPrompt w/ LaPA²Backbone=Pythia 12B, Length=5122025.08 | 39.54 | 18.02 | 2 | 30 | 65 | |
| Palette w/ LaPA²Backbone=Pythia 12B, Length=5122025.08 | 40.08 | 19.78 | 1 | 4 | 20 | |
| Palette w/ LaPA²Backbone=LLaMA-2 13B, Length=642025.08 | 40.53 | 28.27 | 5 | 31 | 63 | |
| Palette w/ LaPA²Backbone=LLaMA-2 7B, Length=642025.08 | 40.88 | 31.3 | 5 | 30 | 61 | |
| NegPrompt w/ LaPA²Backbone=Pythia 12B, Length=642025.08 | 41.15 | 43.58 | 7 | 45 | 76 | |
| PaletteBackbone=LLaMA-2 7B, Length=5122025.08 | 41.19 | 5.86 | 2 | 20 | 49 | |
| PaletteBackbone=LLaMA-2 13B, Length=5122025.08 | 41.81 | 5.09 | 2 | 21 | 51 | |
| PaletteBackbone=LLaMA-2 7B, Length=642025.08 | 42.86 | 18.94 | 6 | 35 | 66 | |
| DATGBackbone=Pythia 12B, Length=5122025.08 | 42.88 | 4.88 | 1 | 2 | 4 | |
| NegPromptBackbone=Pythia 12B, Length=5122025.08 | 42.94 | 12.56 | 2 | 29 | 63 | |
| PaletteBackbone=Pythia 12B, Length=5122025.08 | 43.14 | 8.64 | 1 | 3 | 12 | |
| PaletteBackbone=LLaMA-2 13B, Length=642025.08 | 43.26 | 17.12 | 6 | 36 | 67 | |
| NegPromptBackbone=Pythia 12B, Length=642025.08 | 44.09 | 34.74 | 7 | 44 | 75 |