Tabular Prediction on TabArena medium 10k-100k (full)
2,146Elo RatingTabPFN-3-Thinking
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| TabPFN-3-ThinkingTrain time per 1K [s]=15.10, Predict time per 1K [s]=2.152026.05 | 2,146 | 6.2 | 1.3 | |
| AutoGluon 1.5Setting=extreme, 4h, Train time per 1K [s]=191.18, Predict time per 1K [s]=2.212026.05 | 1,907 | 1.4 | 3.4 | |
| TabPFN-3Setting=Default (D), Train time per 1K [s]=0.83, Predict time per 1K [s]=0.272026.05 | 1,835 | 3.3 | 4.1 | |
| TabPFN-2.6Setting=Default (D), Train time per 1K [s]=2.76, Predict time per 1K [s]=0.702026.05 | 1,741 | 0 | 6.4 | |
| TabICLv2Setting=Default (D), Train time per 1K [s]=0.76, Predict time per 1K [s]=0.142026.05 | 1,712 | 1.9 | 5.3 | |
| RealTabPFN-2.5Setting=Tuned+Ensemble (T+E), Train time per 1K [s]=735.58, Predict time per 1K [s]=11.742026.05 | 1,663 | 0 | 7.2 | |
| RealMLPSetting=Tuned+Ensemble (T+E), Train time per 1K [s]=1719.82, Predict time per 1K [s]=1.672026.05 | 1,645 | 0 | 7.4 | |
| CatBoostSetting=Tuned+Ensemble (T+E), Train time per 1K [s]=777.59, Predict time per 1K [s]=0.252026.05 | 1,625 | 0 | 7.4 | |
| CatBoostSetting=Tuned (T), Train time per 1K [s]=777.59, Predict time per 1K [s]=0.052026.05 | 1,616 | 0.3 | 7.6 | |
| RealTabPFN-2.5Setting=Tuned (T), Train time per 1K [s]=735.58, Predict time per 1K [s]=1.392026.05 | 1,612 | 0.1 | 7.9 | |
| LightGBMSetting=Tuned+Ensemble (T+E), Train time per 1K [s]=131.56, Predict time per 1K [s]=2.642026.05 | 1,604 | 0 | 9.2 | |
| CatBoostSetting=Default (D), Train time per 1K [s]=3.24, Predict time per 1K [s]=0.032026.05 | 1,576 | 0.1 | 7.8 | |
| XGBoostSetting=Tuned+Ensemble (T+E), Train time per 1K [s]=282.13, Predict time per 1K [s]=0.562026.05 | 1,565 | 0.1 | 9.3 | |
| RealMLPSetting=Tuned (T), Train time per 1K [s]=1719.82, Predict time per 1K [s]=0.082026.05 | 1,554 | 0 | 8.7 | |
| TabMSetting=Tuned+Ensemble (T+E), Train time per 1K [s]=1993.14, Predict time per 1K [s]=0.622026.05 | 1,538 | 0.7 | 9.1 | |
| RealTabPFN-2.5Setting=Default (D), Train time per 1K [s]=1.88, Predict time per 1K [s]=0.642026.05 | 1,536 | 0 | 8.7 | |
| TabDPTSetting=Tuned+Ensemble (T+E), Train time per 1K [s]=4786.55, Predict time per 1K [s]=444.542026.05 | 1,533 | 0.8 | 8.8 | |
| LightGBMSetting=Tuned (T), Train time per 1K [s]=131.56, Predict time per 1K [s]=0.132026.05 | 1,515 | 0 | 10.3 | |
| XGBoostSetting=Tuned (T), Train time per 1K [s]=282.13, Predict time per 1K [s]=0.072026.05 | 1,514 | 0 | 9.8 | |
| TabMSetting=Tuned (T), Train time per 1K [s]=1993.14, Predict time per 1K [s]=0.062026.05 | 1,489 | 0 | 9.9 | |
| TabDPTSetting=Tuned (T), Train time per 1K [s]=4786.55, Predict time per 1K [s]=42.642026.05 | 1,411 | 0 | 11.3 | |
| XGBoostSetting=Default (D), Train time per 1K [s]=0.49, Predict time per 1K [s]=0.052026.05 | 1,375 | 0 | 11.7 | |
| TabDPTSetting=Default (D), Train time per 1K [s]=46.62, Predict time per 1K [s]=43.742026.05 | 1,336 | 0 | 14 | |
| TabMSetting=Default (D), Train time per 1K [s]=5.16, Predict time per 1K [s]=0.072026.05 | 1,330 | 0 | 12.6 | |
| RealMLPSetting=Default (D), Train time per 1K [s]=6.75, Predict time per 1K [s]=0.232026.05 | 1,280 | 0 | 13.7 | |
| LightGBMSetting=Default (D), Train time per 1K [s]=0.29, Predict time per 1K [s]=0.042026.05 | 1,263 | 0 | 13.5 |