Classification on LSAC
0.8786AUCSuppression
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SuppressionBackbone=DNN2025.12 | 0.8786 | 0.0389 | 0.0142 | 0.2465 | 0.0131 | 90.59 | 63.75 | |
| 2NBBase Model=LR2025.12 | 0.8739 | — | — | — | — | 91.14 | 65.24 | |
| IPW-SYBase Model=LR2025.12 | 0.8726 | — | — | — | — | 65.38 | 55.32 | |
| IPW-SBackbone=DNN2025.12 | 0.8712 | 0.0509 | 0.0263 | 0.2626 | 0.0209 | 90.56 | 64.47 | |
| IPW-SYBackbone=DNN2025.12 | 0.871 | 0.0459 | 0.0202 | 0.1332 | 0.0067 | 77.05 | 63.01 | |
| OriginalBackbone=DNN2025.12 | 0.869 | 0.0386 | 0.0216 | 0.1598 | 0.0232 | 90.64 | 64.71 | |
| SupreesionBase Model=LR2025.12 | 0.8665 | — | — | — | — | 71.29 | 59.24 | |
| LabelBias-FPRBase Model=LR2025.12 | 0.8665 | — | — | — | — | 71.24 | 59.16 | |
| IFFair-UniformBase Model=LR2025.12 | 0.8665 | — | — | — | — | 71.13 | 59.11 | |
| OriginalBase Model=LR2025.12 | 0.8663 | — | — | — | — | 71 | 58.94 | |
| ARLBase Model=LR2025.12 | 0.8662 | — | — | — | — | 70.95 | 58.93 | |
| LabelBias-DPBase Model=LR2025.12 | 0.8661 | — | — | — | — | 71.32 | 59.22 | |
| IFFair-DiverseBackbone=DNN2025.12 | 0.8636 | 0.0286 | 0.0138 | 0.1241 | 0.0193 | 90.66 | 64.13 | |
| ModifiedNBBase Model=LR2025.12 | 0.8626 | — | — | — | — | 65.65 | 55.43 | |
| IPW-SBase Model=LR2025.12 | 0.8523 | — | — | — | — | 69.74 | 58.12 | |
| IFFair-DiverseBase Model=LR2025.12 | 0.825 | — | — | — | — | 77.82 | 62.77 | |
| LabelBias-EOddsBase Model=LR2025.12 | 0.7191 | — | — | — | — | 57.38 | 46.45 | |
| LatentVBase Model=LR2025.12 | 0.7034 | — | — | — | — | 88.66 | 66.41 | |
| FairMapBase Model=LR2025.12 | 0.517 | — | — | — | — | — | — | |
| 2NBClassifier=LR2025.12 | — | 0.0299 | 0.0143 | 0.1303 | 0.0191 | — | — | |
| ARLClassifier=LR2025.12 | — | 0.0166 | -0.003 | 0.0609 | 0.0127 | — | — | |
| IFFair-DiverseClassifier=LR2025.12 | — | 0.0197 | 0.0002 | 0.0717 | 0.0057 | — | — | |
| IFFair-UniformClassifier=LR2025.12 | — | 0.0222 | 0.0037 | 0.0562 | 0.0061 | — | — | |
| IPW-SClassifier=LR2025.12 | — | -0.1904 | -0.2136 | 0.3322 | 0.1854 | — | — | |
| IPW-SYClassifier=LR2025.12 | — | -0.0461 | -0.0651 | 0.0723 | 0.0652 | — | — | |
| LabelBias-DPClassifier=LR2025.12 | — | -0.0171 | -0.0369 | 0.0617 | 0.0399 | — | — | |
| LabelBias-EOddsClassifier=LR2025.12 | — | 0.9291 | 0.9471 | 1.6794 | 0.7785 | — | — | |
| LabelBias-FPRClassifier=LR2025.12 | — | 0.0119 | -0.007 | 0.0539 | 0.0151 | — | — | |
| LatentVClassifier=LR2025.12 | — | 0.0155 | 0.0042 | 0.0457 | 0.0133 | — | — | |
| ModifiedNBClassifier=LR2025.12 | — | 0.016 | 0.0021 | 0.0113 | 0.006 | — | — | |
| OriginalClassifier=LR2025.12 | — | 0.0457 | 0.0264 | 0.1119 | 0.0111 | — | — | |
| SupreesionClassifier=LR2025.12 | — | 0.0152 | -0.0041 | 0.0565 | 0.0131 | — | — |