Gender Bias Evaluation on RedditBias Gender (test)
3.54RegardDExperts (Anti-only)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| DExperts (Anti-only)Target Model=Llama 3.2 3B, Debiasing=Anti-expert only2024.12 | 3.54 | 0.07 | 28.77 | 62 | |
| Fine-tunedTarget Model=GPT-2 Medium2024.12 | 3.06 | 2.66 | 13.44 | 62.45 | |
| Fine-tunedTarget Model=Llama 3.2 3B2024.12 | 2.03 | 0.87 | 15.43 | 62.89 | |
| No DebiasingTarget Model=GPT-2 Medium2024.12 | 1.97 | 0.23 | 13.53 | 65.58 | |
| No DebiasingTarget Model=Llama 3.2 3B2024.12 | 1.56 | 0.15 | 19.41 | 67.3 | |
| DExperts (Proposed)Target Model=GPT-2 Medium, Debiasing=Full framework2024.12 | 1.47 | 0.18 | 12.98 | 63.12 | |
| DExperts (Proposed)Target Model=Llama 3.2 3B, Debiasing=Full framework2024.12 | 1.07 | 0.24 | 25.82 | 62.39 | |
| DExperts (Anti-only)Target Model=GPT-2 Medium, Debiasing=Anti-expert only2024.12 | 0.85 | 0.09 | 15.48 | 65.44 | |
| TriggerTarget Model=GPT-2 Medium2024.12 | 0.49 | 0.3 | 23.01 | 59.32 |