Text Detoxification on CAPP
48BLEUgpt-3.5-turbo-instruct
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| gpt-3.5-turbo-instructNumber of Demonstrations=402023.10 | 48 | 56.4 | 44.5 | 2.53 | 1.49 | — | — | — | |
| gpt-3.5-turbo-0613Number of Demonstrations=402023.10 | 47.1 | 55 | 43 | 2.33 | 0.72 | — | — | — | |
| gpt-3.5-turbo-1106Number of Demonstrations=402023.10 | 45.8 | 54.8 | 42.5 | 2.29 | 1.3 | — | — | — | |
| MMR-BERTNumber of Demonstrations=102023.10 | 45.5 | 54.4 | 41.8 | 2.2 | 1.05 | — | 4.7538 | 0.3937 | |
| gpt-3.5-turbo-instructNumber of Demonstrations=102023.10 | 44.9 | 53.6 | 41.1 | 2.18 | 1.23 | — | 0.0025 | 0.0031 | |
| text-davinci-003Number of Demonstrations=402023.10 | 44.5 | 53.2 | 40.7 | 2.1 | 1.09 | — | — | — | |
| MMR-EmbeddingNumber of Demonstrations=102023.10 | 44 | 52.4 | 39.9 | 2.1 | 1.34 | — | 0.0025 | 0.3936 | |
| gpt-3.5-turbo-1106Number of Demonstrations=102023.10 | 43.9 | 53.2 | 40.5 | 2.17 | 1.22 | — | — | — | |
| gpt-3.5-turbo-0613Number of Demonstrations=102023.10 | 43.7 | 51.9 | 39.6 | 2 | 0.82 | — | — | — | |
| text-davinci-003Number of Demonstrations=102023.10 | 40.6 | 49.6 | 36.1 | 1.73 | 1.04 | — | — | — | |
| T52023.10 | 39.4 | 50.2 | 37.9 | 1.92 | 2.63 | — | — | — | |
| BART2023.10 | 38.5 | 48.3 | 36.3 | 1.86 | 3.54 | — | — | — | |
| Vicuna-13bNumber of Demonstrations=102023.10 | 37.5 | 35.9 | 33.6 | 1.55 | 1.02 | — | — | — | |
| Vicuna-13bNumber of Demonstrations=42023.10 | 35.8 | 42.4 | 31.3 | 1.34 | 1.04 | — | — | — |