Stereotype Bias Evaluation on StereoSet (test)
77.12Gender SSAuto-Debias
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Auto-DebiasBackbone=Mistral-v0.32026.02 | 77.12 | 92.19 | 42.19 | 61.5 | 91.27 | 70.27 | 70.08 | 91.6 | 54.81 | 60 | 94.94 | 75.95 | |
| IG2Backbone=Mistral-v0.32026.02 | 76.03 | 94.53 | 45.31 | 45.96 | 66.94 | 61.54 | 51.81 | 68.15 | 65.68 | 51.79 | 70.89 | 68.35 | |
| BaseBackbone=Mistral-v0.32026.02 | 72.36 | 96.09 | 53.12 | 60 | 92.52 | 74.01 | 69.39 | 93.58 | 57.28 | 60.81 | 93.67 | 73.42 | |
| Prefix PromptingBackbone=Mistral-v0.32026.02 | 72.27 | 92.97 | 51.56 | 55.1 | 91.68 | 82.33 | 64.27 | 92.59 | 66.17 | 52.86 | 88.61 | 83.54 | |
| FBABackbone=Mistral-v0.32026.02 | 68.33 | 93.75 | 59.38 | 55.11 | 89.4 | 80.25 | 65.8 | 94.57 | 64.69 | 55.4 | 93.67 | 83.54 | |
| BBABackbone=Mistral-v0.32026.02 | 68.33 | 93.75 | 59.38 | 54.19 | 84.41 | 77.34 | 59.08 | 85.68 | 70.12 | 54.93 | 89.87 | 81.01 | |
| DDPBackbone=Mistral-v0.32026.02 | 66.39 | 95.31 | 64.06 | 58.65 | 92.52 | 76.5 | 66.93 | 94.07 | 62.22 | 63.24 | 86.08 | 63.29 | |
| Self-DebiasingBackbone=Mistral-v0.32026.02 | 42.7 | 69.53 | 59.37 | 48.09 | 70.89 | 68.19 | 56.51 | 72.1 | 62.72 | 55.93 | 74.68 | 65.82 |