Harmlessness evaluation on HarmfulQ (test)
100Harmlessness FractionDeAL
Evaluation results
| Method | Links | |
|---|---|---|
| DeALBackbone=MPT-7B-Instruct, Reward Model=R_harmless2024.02 | 100 | |
| DeALBackbone=MPT-7B-Instruct, Reward Model=R_hh2024.02 | 100 | |
| pa (for safety)Backbone=MPT-7B-Instruct2024.02 | 63 | |
| BaseBackbone=MPT-7B-Instruct2024.02 | 43 | |
| Harmless rerankBackbone=MPT-7B-Instruct2024.02 | 40 | |
| Helpful rerankBackbone=MPT-7B-Instruct2024.02 | 37 | |
| DeALBackbone=MPT-7B-Instruct, Reward Model=R_helpful2024.02 | 20 |