Classification on Multi-Color MNIST (Bias Analysis)
100Accuracy (Aligned/Aligned)Vanilla
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Vanillaleft color ratio=0.99, right color ratio=0.952022.07 | 100 | 97.1 | 27.5 | 5.2 | 57.4 | |
| EIILleft color ratio=0.99, right color ratio=0.952022.07 | 100 | 97.2 | 70.8 | 10.9 | 69.7 | |
| DebiAN (w/o UA)left color ratio=0.99, right color ratio=0.95, Unbalanced Assignment penalty=false2022.07 | 100 | 97.2 | 71.6 | 13.8 | 70.6 | |
| DebiANleft color ratio=0.99, right color ratio=0.95, Unbalanced Assignment penalty=true2022.07 | 100 | 95.6 | 76.5 | 16 | 72 | |
| Vanilla2026.03 | 100 | 97.2 | 30.3 | 5.2 | 58.2 | |
| EIIL2026.03 | 100 | 97.2 | 70.8 | 10.9 | 69.7 | |
| DebiAN2026.03 | 100 | 95.6 | 76.5 | 16 | 72 | |
| VCBA2026.03 | 100 | 90.9 | 77.5 | 24.1 | 73.1 | |
| BISE (last)Subnetwork version=last2026.03 | 100 | 88.8 | 44.5 | 7.7 | 60.3 | |
| BISE (last) + finetuningSubnetwork version=last, Fine-tuning=true2026.03 | 100 | 97.5 | 71.1 | 13.7 | 70.6 | |
| LfFleft color ratio=0.99, right color ratio=0.952022.07 | 99.6 | 4.7 | 98.6 | 5.1 | 52 | |
| LfF2026.03 | 99.6 | 4.7 | 98.6 | 5.1 | 52 | |
| PGIleft color ratio=0.99, right color ratio=0.952022.07 | 98.6 | 82.6 | 26.6 | 9.5 | 54.3 | |
| PGI2026.03 | 98.6 | 82.6 | 26.6 | 9.5 | 54.3 | |
| FFWDebiasing with unbiased dataset (*)=true2026.03 | 34.57 | 35.17 | 39.86 | 35.85 | 36.37 |