Face Verification on LFW (Error Gap Analysis)
13.82EO Gap (0.1%)FairCal
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| FairCalBackbone=ArcFace R50, Dem-aware=false2026.06 | 13.82 | 13.57 | 1.41 | 4 | 48.37 | 48.59 | |
| FairCalBackbone=ArcFace (FairFace), Dem-aware=false2026.06 | 13.82 | 13.57 | 1.41 | 4 | 48.37 | 48.59 | |
| BaselineBackbone=ArcFace R50, Dem-aware=false2026.06 | 14.18 | 13.57 | 1.43 | 3.66 | 48.42 | 48.52 | |
| FALCONBackbone=ArcFace R50, Dem-aware=false2026.06 | 14.18 | 13.57 | 1.43 | 3.66 | 48.42 | 48.52 | |
| FRAPPEBackbone=ArcFace R50, Dem-aware=false2026.06 | 14.18 | 13.57 | 1.43 | 3.66 | 48.42 | 48.52 | |
| OracleBackbone=ArcFace R50, Dem-aware=true2026.06 | 14.18 | 13.57 | 1.43 | 3.66 | 48.42 | 48.52 | |
| GSTBackbone=ArcFace R50, Dem-aware=true2026.06 | 14.18 | 13.57 | 1.43 | 3.66 | 48.42 | 48.52 | |
| DemoNormBackbone=ArcFace R50, Dem-aware=true2026.06 | 14.18 | 13.57 | 1.43 | 3.66 | 48.42 | 48.52 | |
| AC-LinearBackbone=ArcFace R50, Dem-aware=false2026.06 | 14.18 | 13.57 | 1.43 | 4.24 | 48.42 | 48.17 | |
| AC-RidgeBackbone=ArcFace R50, Dem-aware=false2026.06 | 14.18 | 13.93 | 1.47 | 5.1 | 48.42 | 46.17 | |
| BaselineBackbone=ArcFace (FairFace), Dem-aware=false2026.06 | 14.18 | 13.57 | 1.43 | 3.66 | 48.42 | 48.52 | |
| FALCONBackbone=ArcFace (FairFace), Dem-aware=false2026.06 | 14.18 | 13.57 | 1.43 | 3.66 | 48.42 | 48.52 | |
| DemoNormBackbone=ArcFace (FairFace), Dem-aware=true2026.06 | 14.18 | 13.57 | 1.43 | 3.92 | 48.42 | 48.52 | |
| AC-LinearBackbone=ArcFace (FairFace), Dem-aware=false2026.06 | 14.18 | 13.57 | 1.43 | 4.24 | 48.42 | 48.17 | |
| FSNBackbone=ArcFace R50, Dem-aware=false2026.06 | 15.01 | 13.94 | 1.57 | 3.96 | 48.21 | 48.16 | |
| FSNBackbone=ArcFace (FairFace), Dem-aware=false2026.06 | 15.01 | 13.94 | 1.57 | 3.96 | 48.21 | 48.16 | |
| OracleBackbone=ArcFace (FairFace), Dem-aware=true2026.06 | 17.64 | 14.18 | 4.46 | 7.75 | 48.7 | 49.44 | |
| FRAPPEBackbone=ArcFace (FairFace), Dem-aware=false2026.06 | 19.43 | 14.23 | 2.86 | 5.31 | 48.76 | 49.45 | |
| DemoNormBackbone=AdaFace, Dem-aware=true2026.06 | 20.41 | 15.54 | 2.14 | 6.28 | 44.21 | 47.86 | |
| BaselineBackbone=AdaFace, Dem-aware=false2026.06 | 22.17 | 19.36 | 2.14 | 5.08 | 43.5 | 47.84 | |
| FALCONBackbone=AdaFace, Dem-aware=false2026.06 | 22.86 | 19.36 | 2.14 | 5.08 | 42.95 | 47.93 | |
| OracleBackbone=AdaFace, Dem-aware=true2026.06 | 23.23 | 19.03 | 2.94 | 5.13 | 45.21 | 47.8 | |
| AC-LinearBackbone=AdaFace, Dem-aware=false2026.06 | 23.52 | 15.55 | 1.91 | 3.22 | 41.2 | 48.76 | |
| FairCalBackbone=AdaFace, Dem-aware=false2026.06 | 24.58 | 21.68 | 2.33 | 4.78 | 40.67 | 47.41 | |
| AC-RidgeBackbone=AdaFace, Dem-aware=false2026.06 | 24.62 | 17.19 | 1.9 | 3.66 | 38.85 | 49.34 | |
| FRAPPEBackbone=AdaFace, Dem-aware=false2026.06 | 30.69 | 23.86 | 2.12 | 3.01 | 41.44 | 46.7 | |
| AC-MLPBackbone=ArcFace (FairFace), Dem-aware=false2026.06 | 32.3 | 23.69 | 1.73 | 4.14 | 43.1 | 47.7 | |
| AC-MLPBackbone=ArcFace R50, Dem-aware=false2026.06 | 32.48 | 29.39 | 1.37 | 4.44 | 43.73 | 46.69 | |
| GSTBackbone=AdaFace, Dem-aware=true2026.06 | 32.56 | 27.74 | 2.14 | 5.08 | 46.81 | 50.62 | |
| GSTBackbone=ArcFace (FairFace), Dem-aware=true2026.06 | 38.35 | 24.3 | 1.29 | 3.87 | 54.57 | 50.69 | |
| AC-LinearBackbone=ArcFace R100, Dem-aware=false2026.06 | 39.84 | 37.52 | 1.91 | 3.18 | 37.71 | 46.13 | |
| OracleBackbone=ArcFace R100, Dem-aware=true2026.06 | 41.33 | 41.52 | 2.33 | 8.87 | 37.98 | 47.54 | |
| AC-RidgeBackbone=ArcFace R100, Dem-aware=false2026.06 | 41.52 | 42.23 | 2.4 | 4.55 | 36.32 | 47.05 | |
| BaselineBackbone=ArcFace R100, Dem-aware=false2026.06 | 46.09 | 41.33 | 1.65 | 8.98 | 40.12 | 46.96 | |
| FALCONBackbone=ArcFace R100, Dem-aware=false2026.06 | 46.39 | 39.91 | 1.25 | 8.83 | 41.34 | 47.35 | |
| AC-MLPBackbone=ArcFace R100, Dem-aware=false2026.06 | 46.56 | 51.96 | 2.18 | 6.15 | 35.42 | 40.67 | |
| AC-MLPBackbone=AdaFace, Dem-aware=false2026.06 | 47.3 | 45.78 | 3.44 | 10.34 | 32.55 | 35.09 | |
| FSNBackbone=ArcFace R100, Dem-aware=false2026.06 | 48.63 | 50.44 | 3.58 | 5.73 | 35.99 | 42 | |
| DemoNormBackbone=ArcFace R100, Dem-aware=true2026.06 | 50.26 | 39.5 | 1.66 | 8.92 | 37.63 | 44.13 | |
| FRAPPEBackbone=ArcFace R100, Dem-aware=false2026.06 | 50.67 | 44.84 | 2.14 | 4.93 | 39.26 | 43.61 | |
| FSNBackbone=AdaFace, Dem-aware=false2026.06 | 51.19 | 42.59 | 3.24 | 4.06 | 36.3 | 40.66 | |
| FairCalBackbone=ArcFace R100, Dem-aware=false2026.06 | 52.28 | 45.03 | 1.34 | 4.68 | 39.78 | 47.44 | |
| GSTBackbone=ArcFace R100, Dem-aware=true2026.06 | 52.47 | 43.83 | 1.76 | 4.35 | 40.08 | 45.34 |