Weight-based Bias Detection on Colored-MNIST Level 4
100Accuracy (Red Biased)WeightBias
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| WeightBiasArchitecture=dxd-max, Severity=I, Training Distribution Ratio=(99/.5/.5)2026.07 | 100 | 100 | 100 | 100 | |
| WeightBiasArchitecture=dxd-conv, Severity=I, Training Distribution Ratio=(99/.5/.5)2026.07 | 99.95 | 99.9 | 99.9 | 99.9 | |
| WeightBiasArchitecture=dxd-max, Severity=II, Training Distribution Ratio=(90/5/5)2026.07 | 99.85 | 99.88 | 99.94 | 99.94 | |
| WeightBiasArchitecture=dxd-conv, Severity=II, Training Distribution Ratio=(90/5/5)2026.07 | 99.84 | 99.54 | 99.83 | 98.37 | |
| WeightBiasArchitecture=dxd-max, Severity=III, Training Distribution Ratio=(80/10/10)2026.07 | 99.2 | 99.85 | 99 | 98.45 | |
| WeightBiasArchitecture=dxd-conv, Severity=III, Training Distribution Ratio=(80/10/10)2026.07 | 96.65 | 99.15 | 98.3 | 96.95 | |
| WeightBiasArchitecture=dxd-max, Severity=IV, Training Distribution Ratio=(60/20/20)2026.07 | 94.25 | 97.8 | 93.45 | 88.05 | |
| WeightBiasArchitecture=dxd-conv, Severity=IV, Training Distribution Ratio=(60/20/20)2026.07 | 91.4 | 96.45 | 95 | 83.5 |