Group Fairness on 8 health datasets aggregated across 4 attributes
0.104DP DifferenceOrionMSPv1.5→MLP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| OrionMSPv1.5→MLPStudent Architecture=MLP, Teacher=OrionMSPv1.5, Distillation=single-teacher2026.05 | 0.104 | 0.216 | 0.049 | 0.014 | |
| TabICLv2→MLPStudent Architecture=MLP, Teacher=TabICLv2, Distillation=single-teacher2026.05 | 0.106 | 0.165 | 0.048 | 0.001 | |
| LimiX→MLPStudent Architecture=MLP, Teacher=LimiX, Distillation=single-teacher2026.05 | 0.108 | 0.187 | 0.026 | 0.043 | |
| TabPFNv2.6→MLPStudent Architecture=MLP, Teacher=TabPFNv2.6, Distillation=single-teacher2026.05 | 0.108 | 0.162 | 0.036 | 0.019 | |
| [PFNv2.6+OrionMSP+Limix]→MLPStudent Architecture=MLP, Teachers=TabPFNv2.6, Orion-MSP v1.5, LimiX, Distillation=multi-teacher2026.05 | 0.111 | 0.193 | 0.034 | 0.049 | |
| [PFNv2.6+ICL+Limix]→MLPStudent Architecture=MLP, Teachers=TabPFNv2.6, TabICLv2, LimiX, Distillation=multi-teacher2026.05 | 0.114 | 0.207 | 0.03 | 0.063 | |
| [PFNv2.6+Limix]→MLPStudent Architecture=MLP, Teachers=TabPFNv2.6, LimiX, Distillation=multi-teacher2026.05 | 0.116 | 0.219 | 0.029 | 0.075 | |
| TabDPT→MLPStudent Architecture=MLP, Teacher=TabDPT, Distillation=single-teacher2026.05 | 0.117 | 0.178 | 0.026 | 0.022 | |
| [PFNv2.6+OrionMSP+Limix]→LGBMStudent Architecture=LGBM, Teachers=TabPFNv2.6, Orion-MSP v1.5, LimiX, Distillation=multi-teacher2026.05 | 0.129 | 0.13 | 0.016 | 0.014 | |
| LimiX→LGBMStudent Architecture=LGBM, Teacher=LimiX, Distillation=single-teacher2026.05 | 0.13 | 0.125 | 0.005 | 0.018 | |
| LogisticRegressionModel Type=Baseline2026.05 | 0.131 | 0.183 | — | — | |
| TabPFNv2.6→LGBMStudent Architecture=LGBM, Teacher=TabPFNv2.6, Distillation=single-teacher2026.05 | 0.131 | 0.125 | 0.014 | 0.019 | |
| OrionMSPv1.5→LGBMStudent Architecture=LGBM, Teacher=OrionMSPv1.5, Distillation=single-teacher2026.05 | 0.132 | 0.173 | 0.021 | 0.029 | |
| [PFNv2.6+Limix]→LGBMStudent Architecture=LGBM, Teachers=TabPFNv2.6, LimiX, Distillation=multi-teacher2026.05 | 0.133 | 0.126 | 0.012 | 0.017 | |
| LimiXModel Type=Teacher2026.05 | 0.134 | 0.144 | — | — | |
| [PFNv2.6+ICL+Limix]→LGBMStudent Architecture=LGBM, Teachers=TabPFNv2.6, TabICLv2, LimiX, Distillation=multi-teacher2026.05 | 0.135 | 0.12 | 0.01 | 0.024 | |
| TabDPT→LGBMStudent Architecture=LGBM, Teacher=TabDPT, Distillation=single-teacher2026.05 | 0.136 | 0.171 | 0.007 | 0.015 | |
| TabICLv2→LGBMStudent Architecture=LGBM, Teacher=TabICLv2, Distillation=single-teacher2026.05 | 0.139 | 0.136 | 0.015 | 0.031 | |
| TabDPTModel Type=Teacher2026.05 | 0.143 | 0.156 | — | — | |
| XGBoostModel Type=Baseline2026.05 | 0.145 | 0.165 | — | — | |
| LightGBMModel Type=Baseline2026.05 | 0.145 | 0.167 | — | — | |
| TabPFNv2.6Model Type=Teacher2026.05 | 0.145 | 0.144 | — | — | |
| Orion-MSP v1.5Model Type=Teacher2026.05 | 0.153 | 0.202 | — | — | |
| TabICLv2Model Type=Teacher2026.05 | 0.154 | 0.166 | — | — |