Question Answering Bias Evaluation on BBQ
79Accuracy (All)Mistral-7B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Mistral-7BParameters=7B2024.07 | 79 | 67 | 67 | 76 | |
| Phi-2 + BiasDPOParameters=2.7B, Alignment=BiasDPO2024.07 | 65 | 68 | 87 | 69 | |
| Phi-2Parameters=2.7B2024.07 | 50 | 60 | 77 | 54 | |
| Gemma-2BParameters=2B2024.07 | 36 | 36 | 30 | 27 | |
| StableLM-3BParameters=3B2024.07 | 32 | 32 | 28 | 31 | |
| GRPO2026.06 | 31.23 | 44.5 | 22.5 | 23.67 | |
| PPO2026.06 | 29.96 | 43 | 20.9 | 23.33 | |
| DPO2026.06 | 28.23 | 41.4 | 19.7 | 20.5 | |
| Base2026.06 | 27.5 | 41 | 18.9 | 19.33 |