Toxicity and Diversity Evaluation on SafeNLP
0.028ToxicityMistral-7b-Instruct + CP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Mistral-7b-Instruct + CPBackbone=Mistral-7b-Instruct, Evaluation Mode=white-box, Contrastive Perplexity=true2024.01 | 0.028 | 0.09 | 0.41 | 0.68 | |
| Mistral-7b + CPBackbone=Mistral-7b, Evaluation Mode=white-box, Contrastive Perplexity=true2024.01 | 0.043 | 0.3 | 0.6 | 0.72 | |
| CHRTBackbone=Mistral-7b, Evaluation Mode=white-box2024.01 | 0.132 | 0.1 | 0.19 | 0.21 | |
| CHRTBackbone=GPT-2, Evaluation Mode=white-box2024.01 | 0.257 | 0.44 | 0.7 | 0.71 | |
| Mistral-7b-InstructEvaluation Mode=white-box2024.01 | 0.269 | 0.18 | 0.54 | 0.76 | |
| Mistral-7bEvaluation Mode=white-box2024.01 | 0.331 | 0.32 | 0.59 | 0.65 |