Occupation Classification on Bias-in-Bio lightweight (test)
77.32Overall AccuracyFBA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FBABackbone=Llama-3.22026.02 | 77.32 | 76.19 | 78.54 | 2.38 | 14.9 | |
| DDPBackbone=Llama-3.12026.02 | 77.11 | 74.3 | 80.47 | 5.72 | 30.41 | |
| Self-DebiasingBackbone=Llama-3.12026.02 | 76.46 | 73.93 | 79.47 | 5.54 | 25.87 | |
| BBABackbone=Llama-3.22026.02 | 75 | 70.01 | 79.41 | 1.02 | 10.48 | |
| Prefix PromptingBackbone=Llama-3.12026.02 | 73.72 | 69.83 | 78.41 | 7.3 | 28.85 | |
| FBABackbone=Llama-3.12026.02 | 73.35 | 69.93 | 77.51 | 5.86 | 26.43 | |
| BaseBackbone=Llama-3.12026.02 | 72.44 | 69.16 | 76.39 | 6.05 | 28.5 | |
| Auto-DebiasBackbone=Llama-3.12026.02 | 72.31 | 68.94 | 76.39 | 6.14 | 28.43 | |
| IG2Backbone=Llama-3.22026.02 | 72.04 | 69.87 | 74.62 | 3.79 | 25.13 | |
| Auto-DebiasBackbone=Llama-3.22026.02 | 71.78 | 69.2 | 74.87 | 4.29 | 27.29 | |
| BaseBackbone=Llama-3.22026.02 | 71.47 | 68.68 | 74.84 | 4.5 | 25.61 | |
| IG2Backbone=Llama-3.12026.02 | 71.44 | 68.6 | 74.88 | 4.42 | 27.83 | |
| BBABackbone=Llama-3.12026.02 | 71.21 | 71.6 | 70.59 | 1.39 | 6.53 | |
| Self-DebiasingBackbone=Llama-3.22026.02 | 70.7 | 67.93 | 74.03 | 5.44 | 30.23 | |
| Prefix PromptingBackbone=Llama-3.22026.02 | 70.47 | 67.43 | 74.12 | 5.38 | 30.88 | |
| DDPBackbone=Llama-3.22026.02 | 54.92 | 53.92 | 56.14 | 1.2 | 29.08 |