Bias Mitigation on Bias in Bios
94.72AccuracyPASTA
Evaluation results
| Method | Links | |
|---|---|---|
| PASTAModel=Gemma3-12B2026.03 | 94.72 | |
| SEKAModel=Gemma3-12B2026.03 | 93.04 | |
| AdaSEKAModel=Gemma3-4B2026.03 | 92.92 | |
| **-markedModel=Gemma3-12B2026.03 | 92.9 | |
| SEKAModel=Gemma3-4B2026.03 | 92.42 | |
| AdaSEKAModel=Qwen3-4B2026.03 | 91.86 | |
| w/o learnModel=Gemma3-12B, Configuration=Ablation: random projections2026.03 | 91.84 | |
| OriginalModel=Gemma3-12B2026.03 | 91.26 | |
| AdaSEKAModel=Qwen3-14B2026.03 | 91.22 | |
| AdaSEKAModel=Gemma3-12B2026.03 | 91.14 | |
| SEKAModel=Qwen3-4B2026.03 | 91.02 | |
| **-markedModel=Gemma3-4B2026.03 | 91 | |
| **-markedModel=Qwen3-14B2026.03 | 90.94 | |
| w/o learn&filtModel=Gemma3-12B, Configuration=Ablation: remove head filtering2026.03 | 90.54 | |
| SEKAModel=Qwen3-14B2026.03 | 90.28 | |
| OriginalModel=Gemma3-4B2026.03 | 89.9 | |
| PASTAModel=Qwen3-4B2026.03 | 89.58 | |
| SEKAModel=Qwen3-8B2026.03 | 88.74 | |
| AdaSEKAModel=Qwen3-8B2026.03 | 88.5 | |
| PASTAModel=Qwen3-14B2026.03 | 88.46 | |
| w/o learn&filtModel=Qwen3-14B, Configuration=Ablation: remove head filtering2026.03 | 88.44 | |
| w/o learnModel=Qwen3-14B, Configuration=Ablation: random projections2026.03 | 88.02 | |
| w/o learnModel=Qwen3-8B, Configuration=Ablation: random projections2026.03 | 87.26 | |
| w/o learnModel=Qwen3-4B, Configuration=Ablation: random projections2026.03 | 86.62 | |
| PASTAModel=Qwen3-8B2026.03 | 86.32 | |
| w/o learnModel=Gemma3-4B, Configuration=Ablation: random projections2026.03 | 85.6 | |
| OriginalModel=Qwen3-14B2026.03 | 85.22 | |
| **-markedModel=Qwen3-4B2026.03 | 82.94 | |
| PASTAModel=Gemma3-4B2026.03 | 82.58 | |
| **-markedModel=Qwen3-8B2026.03 | 80.6 | |
| OriginalModel=Qwen3-4B2026.03 | 79.84 | |
| w/o learn&filtModel=Gemma3-4B, Configuration=Ablation: remove head filtering2026.03 | 77.16 | |
| OriginalModel=Qwen3-8B2026.03 | 76.08 | |
| w/o learn&filtModel=Qwen3-8B, Configuration=Ablation: remove head filtering2026.03 | 74.9 | |
| w/o learn&filtModel=Qwen3-4B, Configuration=Ablation: remove head filtering2026.03 | 71.76 | |
| SPAModel=Qwen3-4B2026.03 | 68 | |
| SPAModel=Qwen3-14B2026.03 | 57.86 | |
| SPAModel=Gemma3-4B2026.03 | 48.02 | |
| SPAModel=Gemma3-12B2026.03 | 46.88 | |
| SPAModel=Qwen3-8B2026.03 | 37.02 |