Bias Mitigation on RedditBias Race
2.08RegardFinetuned
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| FinetunedTarget Model=Llama 3.2 3B, Debiasing=Finetuned2024.12 | 2.08 | 2.75 | 8.05 | 61.39 | 94.87 | 11 | |
| NoneTarget Model=GPT-2 Medium, Debiasing=None2024.12 | 2.05 | 0.15 | 8.65 | 61.44 | 92.36 | 19.1 | |
| FinetunedTarget Model=GPT-2 Medium, Debiasing=Finetuned2024.12 | 1.9 | 1.38 | 8.44 | 58.2 | 92.91 | 27.12 | |
| DExpertsTarget Model=GPT-2 Medium, Debiasing=Proposed2024.12 | 1.84 | 0.15 | 9.58 | 50.1 | 90.81 | 20.12 | |
| DExperts (Anti-only)Target Model=GPT-2 Medium, Debiasing=Anti-only2024.12 | 1.75 | 0.03 | 11.36 | 55.09 | 86.26 | 27.06 | |
| NoneTarget Model=Llama 3.2 3B, Debiasing=None2024.12 | 1.57 | 0.03 | 9.96 | 63.88 | 92.23 | 10.36 | |
| DExperts (Anti-only)Target Model=Llama 3.2 3B, Debiasing=Anti-only2024.12 | 0.87 | 0.04 | 26.42 | 48.21 | 73.84 | 15.63 | |
| DExpertsTarget Model=Llama 3.2 3B, Debiasing=Proposed2024.12 | 0.84 | 0.08 | 28.31 | 51.42 | 88.26 | 11.03 |