Classification on Bank (Accuracy, F1, AUC, and Fairness Deltas)
83.55F1 ScoreExpert API
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Expert API2024.10 | 83.55 | — | — | — | — | — | — | — | |
| Llamdex-MLP2024.10 | 82.28 | — | — | — | — | — | — | — | |
| SuppressionBackbone=DNN2025.12 | 81.6 | 0.0063 | 0.0367 | 0.0388 | 0.0104 | 95.99 | 70.36 | — | |
| Real Data LoRA2024.10 | 79.88 | — | — | — | — | — | — | — | |
| RNSModel Interpretability=Interpretable2024.08 | 77.62 | — | — | — | — | — | — | — | |
| TabNetModel Interpretability=Non-interpretable2024.08 | 77.54 | — | — | — | — | — | — | — | |
| RRLModel Interpretability=Interpretable2024.08 | 77.18 | — | — | — | — | — | — | — | |
| NODEModel Interpretability=Non-interpretable2024.08 | 77.16 | — | — | — | — | — | — | — | |
| FTModel Interpretability=Non-interpretable2024.08 | 77.04 | — | — | — | — | — | — | — | |
| VIMEModel Interpretability=Non-interpretable2024.08 | 76.59 | — | — | — | — | — | — | — | |
| IPW-SBackbone=DNN2025.12 | 76.2 | 0.0053 | 0.0533 | 0.0572 | 0.0176 | 96.13 | 88.77 | — | |
| TabTransModel Interpretability=Non-interpretable2024.08 | 75.67 | — | — | — | — | — | — | — | |
| KNNModel Interpretability=Interpretable2024.08 | 75.61 | — | — | — | — | — | — | — | |
| SAINTModel Interpretability=Non-interpretable2024.08 | 75.6 | — | — | — | — | — | — | — | |
| LGBMModel Interpretability=Non-interpretable2024.08 | 75.28 | — | — | — | — | — | — | — | |
| LORDModel Interpretability=Interpretable2024.08 | 74.9 | — | — | — | — | — | — | — | |
| XGBModel Interpretability=Non-interpretable2024.08 | 74.71 | — | — | — | — | — | — | — | |
| CRSModel Interpretability=Interpretable2024.08 | 73.34 | — | — | — | — | — | — | — | |
| RFModel Interpretability=Non-interpretable2024.08 | 72.67 | — | — | — | — | — | — | — | |
| SBRLModel Interpretability=Interpretable2024.08 | 72.67 | — | — | — | — | — | — | — | |
| BNNModel Interpretability=Non-interpretable2024.08 | 72.49 | — | — | — | — | — | — | — | |
| PLNNModel Interpretability=Non-interpretable2024.08 | 72.4 | — | — | — | — | — | — | — | |
| PTURSModel Interpretability=Interpretable2024.08 | 71.84 | — | — | — | — | — | — | — | |
| CARTModel Interpretability=Interpretable2024.08 | 71.38 | — | — | — | — | — | — | — | |
| C4.5Model Interpretability=Interpretable2024.08 | 71.24 | — | — | — | — | — | — | — | |
| LRModel Interpretability=Interpretable2024.08 | 69.81 | — | — | — | — | — | — | — | |
| RIPPERModel Interpretability=Interpretable2024.08 | 69.76 | — | — | — | — | — | — | — | |
| Original LLM2024.10 | 69.36 | — | — | — | — | — | — | — | |
| DRNETModel Interpretability=Interpretable2024.08 | 68.45 | — | — | — | — | — | — | — | |
| 2NBBase Model=LR2025.12 | 66.96 | — | — | — | — | 96.79 | 88.32 | — | |
| CORELSModel Interpretability=Interpretable2024.08 | 66.86 | — | — | — | — | — | — | — | |
| SVMModel Interpretability=Non-interpretable2024.08 | 66.78 | — | — | — | — | — | — | — | |
| IFFair-DiverseBackbone=DNN2025.12 | 64.6 | -0.0062 | -0.01 | 0.0174 | 0.0029 | 96.79 | 91.67 | — | |
| STGModel Interpretability=Non-interpretable2024.08 | 60.24 | — | — | — | — | — | — | — | |
| OriginalBackbone=DNN2025.12 | 58.03 | 0.0066 | 0.12 | 0.1227 | 0.004 | 96.9 | 94.31 | — | |
| IPW-SYBackbone=DNN2025.12 | 55.77 | 0.0125 | -0.0367 | 0.0502 | 0.0661 | 92.7 | 90.35 | — | |
| IFFair-UniformBase Model=LR2025.12 | 50.67 | — | — | — | — | 71.68 | 97.02 | — | |
| LatentVBase Model=LR2025.12 | 50.39 | — | — | — | — | 71.24 | 96.82 | — | |
| LabelBias-FPRBase Model=LR2025.12 | 49.99 | — | — | — | — | 70.58 | 97.34 | — | |
| SupreesionBase Model=LR2025.12 | 49.92 | — | — | — | — | 70.46 | 97.35 | — | |
| IFFair-DiverseBase Model=LR2025.12 | 49.92 | — | — | — | — | 70.46 | 96.55 | — | |
| OriginalBase Model=LR2025.12 | 49.79 | — | — | — | — | 70.24 | 97.38 | — | |
| ModifiedNBBase Model=LR2025.12 | 49.79 | — | — | — | — | 70.24 | 97.38 | — | |
| LabelBias-DPBase Model=LR2025.12 | 49.79 | — | — | — | — | 70.24 | 97.38 | — | |
| LabelBias-EOddsBase Model=LR2025.12 | 49.79 | — | — | — | — | 70.24 | 96.79 | — | |
| ARLBase Model=LR2025.12 | 49.52 | — | — | — | — | 69.8 | 97.35 | — | |
| IPW-SYBase Model=LR2025.12 | 45.09 | — | — | — | — | 62.5 | 93.47 | — | |
| IPW-SBase Model=LR2025.12 | 39.29 | — | — | — | — | 53.54 | 76.43 | — | |
| 2NBClassifier=LR2025.12 | — | 0.0047 | 0.03 | 0.0324 | 0.0054 | — | — | — | |
| ARLClassifier=LR2025.12 | — | -0.0703 | 0 | 0.0762 | 0.0757 | — | — | — | |
| AutoFe2026.05 | — | — | — | — | — | — | 86.5 | — | |
| AutoFeat2026.04 | — | — | — | — | — | — | 86.9 | — | |
| Base2026.04 | — | — | — | — | — | — | 86.9 | — | |
| CAAFE2026.04 | — | — | — | — | — | — | 87.4 | — | |
| CAAFE2026.05 | — | — | — | — | — | — | 90.5 | — | |
| CALMCategory=CALM, Protocol=5-fold CV2026.02 | — | — | — | — | — | 90.5 | — | — | |
| DFS2026.04 | — | — | — | — | — | — | 89.1 | — | |
| DFS2026.05 | — | — | — | — | — | — | 89.7 | — | |
| DP-GBBase Learner=Gradient Boosting2026.02 | — | — | — | — | — | — | — | 53.2 | |
| DP-LGBMBase Learner=LightGBM2026.02 | — | — | — | — | — | — | — | 61 | |
| EB2MCategory=GA2M, Protocol=5-fold CV2026.02 | — | — | — | — | — | 90.9 | — | — | |
| EBMCategory=GAM, Protocol=5-fold CV2026.02 | — | — | — | — | — | 90.2 | — | — | |
| EurekaLLM Backbone=Qwen2026.05 | — | — | — | — | — | — | 93.2 | — | |
| EurekaLLM Backbone=32B2026.05 | — | — | — | — | — | — | 93.2 | — | |
| EurekaLLM Backbone=gpt4o2026.05 | — | — | — | — | — | — | 93.4 | — | |
| EurekaLLM Backbone=grok22026.05 | — | — | — | — | — | — | 93.4 | — | |
| FairMapBase Model=LR2025.12 | — | — | — | — | — | — | 50.8 | — | |
| FeatLLM2026.05 | — | — | — | — | — | — | 85.1 | — | |
| GAMICategory=GA2M, Protocol=5-fold CV2026.02 | — | — | — | — | — | 90.8 | — | — | |
| IFFair-DiverseClassifier=LR2025.12 | — | 0.0039 | 0 | 0.0002 | 0.0014 | — | — | — | |
| IFFair-UniformClassifier=LR2025.12 | — | -0.0024 | 0 | 0.0063 | 0.0077 | — | — | — | |
| IPW-SClassifier=LR2025.12 | — | 0.5511 | 0.34 | 0.8956 | 0.5287 | — | — | — | |
| IPW-SYClassifier=LR2025.12 | — | 0.3261 | 0.25 | 0.5752 | 0.307 | — | — | — | |
| LabelBias-DPClassifier=LR2025.12 | — | -0.0756 | 0 | 0.0816 | 0.0809 | — | — | — | |
| LabelBias-EOddsClassifier=LR2025.12 | — | 0.0476 | 0 | 0.0452 | 0.0423 | — | — | — | |
| LabelBias-FPRClassifier=LR2025.12 | — | -0.0631 | 0 | 0.0688 | 0.0685 | — | — | — | |
| LatentVClassifier=LR2025.12 | — | -0.0874 | 0 | 0.0939 | 0.0928 | — | — | — | |
| LLMFE2026.04 | — | — | — | — | — | — | 87.5 | — | |
| MALMAS2026.04 | — | — | — | — | — | — | 89.5 | — | |
| ModifiedNBClassifier=LR2025.12 | — | -0.0756 | 0 | 0.0816 | 0.0809 | — | — | — | |
| MTGB2026.02 | — | — | — | — | — | — | — | 57.6 | |
| NAMCategory=GAM, Protocol=5-fold CV2026.02 | — | — | — | — | — | 90.1 | — | — | |
| NODECategory=GA2M, Protocol=5-fold CV2026.02 | — | — | — | — | — | 90.3 | — | — | |
| OCTree2026.04 | — | — | — | — | — | — | 87.3 | — | |
| OpenFe2026.05 | — | — | — | — | — | — | 92.3 | — | |
| OpenFE2026.04 | — | — | — | — | — | — | 90.4 | — | |
| OriginalClassifier=LR2025.12 | — | -0.0756 | 0 | 0.0816 | 0.0809 | — | — | — | |
| R-MTGB2026.02 | — | — | — | — | — | — | — | 59 | |
| RMB-CLE-via-LGBMBase Learner=LightGBM2026.02 | — | — | — | — | — | — | — | 70.8 | |
| RMB-CLE-via-MTGBBase Learner=Multi-Task Gradient Boosting2026.02 | — | — | — | — | — | — | — | 58.7 | |
| ST-GBBase Learner=Gradient Boosting2026.02 | — | — | — | — | — | — | — | 55.5 | |
| ST-LGBMBase Learner=LightGBM2026.02 | — | — | — | — | — | — | — | 61.7 | |
| SupreesionClassifier=LR2025.12 | — | -0.07 | 0 | 0.0759 | 0.0754 | — | — | — | |
| TabPFN2026.05 | — | — | — | — | — | — | 90.4 | — | |
| TaF-GBBase Learner=Gradient Boosting2026.02 | — | — | — | — | — | — | — | 53.2 | |
| TaF-LGBMBase Learner=LightGBM2026.02 | — | — | — | — | — | — | — | 61 | |
| XGBCategory=BB, Protocol=5-fold CV2026.02 | — | — | — | — | — | 90.8 | — | — |