Helpfulness, Honesty, and Harmlessness Alignment Evaluation on BBH HHH
95Harmlessness ScoreGPT-4
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-42023.08 | 95 | 85 | 80 | 91 | 87 | |
| CHATGPT2023.08 | 95 | 85 | 80 | 91 | 87 | |
| VICUNAParameters=13B2023.08 | 89.6 | 65.5 | 59.3 | 83.7 | 74.5 | |
| STABLEBELUGAParameters=13B2023.08 | 81 | 75.4 | 81.3 | 86 | 81 | |
| STARLINGData=BLUE-RED, Strategy=B2023.08 | 81 | 54.1 | 67.8 | 79 | 70.1 | |
| STARLINGData=BLUE, Strategy=A2023.08 | 70.7 | 59 | 64.4 | 74.4 | 67.1 | |
| VICUNAParameters=7B2023.08 | 68.9 | 59 | 55.9 | 69.7 | 63.4 | |
| STABLEBELUGAParameters=7B2023.08 | 68.9 | 68.8 | 64.4 | 79.1 | 70.3 | |
| VICUNA-FTParameters=7B, fine-tuned=true2023.08 | 68.9 | 62.3 | 55.9 | 72.1 | 64.8 | |
| LLAMA2-FTParameters=7B, fine-tuned=true2023.08 | 56.9 | 57.4 | 54.2 | 72.1 | 60.2 |