Tabular Prediction on TabArena small (full 681 tasks)
1,723Elo RatingTabPFN-3
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| TabPFN-3Configuration=Thinking, Train time per 1K [s]=52.78, Predict time per 1K [s]=3.402026.05 | 1,723 | 7 | 6.1 | |
| AutoGluon 1.5Search Strategy=extreme, Time Budget=4h, Train time per 1K [s]=346.57, Predict time per 1K [s]=6.562026.05 | 1,641 | 4.4 | 6.6 | |
| TabPFN-3Configuration=Default (D), Train time per 1K [s]=4.84, Predict time per 1K [s]=1.542026.05 | 1,638 | 2.9 | 8.1 | |
| RealTabPFN-2.5Configuration=Tuned + Ensembled (T+E), Train time per 1K [s]=2289.05, Predict time per 1K [s]=8.052026.05 | 1,598 | 2.1 | 8.7 | |
| TabPFN-2.6Configuration=Default (D), Train time per 1K [s]=7.03, Predict time per 1K [s]=0.552026.05 | 1,596 | 1.3 | 9.7 | |
| TabICLv2Configuration=Default (D), Train time per 1K [s]=7.06, Predict time per 1K [s]=0.672026.05 | 1,574 | 3.4 | 8.7 | |
| RealTabPFN-2.5Configuration=Tuned (T), Train time per 1K [s]=2289.05, Predict time per 1K [s]=1.142026.05 | 1,556 | 1.2 | 9.5 | |
| RealTabPFN-2.5Configuration=Default (D), Train time per 1K [s]=6.76, Predict time per 1K [s]=0.642026.05 | 1,542 | 0.9 | 9.9 | |
| RealMLPConfiguration=Tuned + Ensembled (T+E), Train time per 1K [s]=3770.75, Predict time per 1K [s]=21.902026.05 | 1,482 | 0.5 | 12.7 | |
| TabDPTConfiguration=Tuned + Ensembled (T+E), Train time per 1K [s]=5119.36, Predict time per 1K [s]=218.712026.05 | 1,448 | 1.2 | 12.9 | |
| TabMConfiguration=Tuned + Ensembled (T+E), Train time per 1K [s]=3553.12, Predict time per 1K [s]=1.742026.05 | 1,430 | 0.4 | 14 | |
| TabDPTConfiguration=Tuned (T), Train time per 1K [s]=5119.36, Predict time per 1K [s]=28.352026.05 | 1,414 | 0.7 | 13.6 | |
| RealMLPConfiguration=Tuned (T), Train time per 1K [s]=3770.75, Predict time per 1K [s]=1.782026.05 | 1,402 | 0.4 | 14.2 | |
| LightGBMConfiguration=Tuned + Ensembled (T+E), Train time per 1K [s]=892.41, Predict time per 1K [s]=2.572026.05 | 1,392 | 0.1 | 15.5 | |
| TabMConfiguration=Tuned (T), Train time per 1K [s]=3553.12, Predict time per 1K [s]=0.242026.05 | 1,368 | 0.3 | 15 | |
| CatBoostConfiguration=Tuned + Ensembled (T+E), Train time per 1K [s]=2476.51, Predict time per 1K [s]=0.812026.05 | 1,362 | 0.1 | 15.6 | |
| LightGBMConfiguration=Tuned (T), Train time per 1K [s]=892.41, Predict time per 1K [s]=0.352026.05 | 1,357 | 0 | 15.9 | |
| CatBoostConfiguration=Tuned (T), Train time per 1K [s]=2476.51, Predict time per 1K [s]=0.102026.05 | 1,351 | 0.1 | 15.8 | |
| TabDPTConfiguration=Default (D), Train time per 1K [s]=50.32, Predict time per 1K [s]=43.712026.05 | 1,331 | 0.3 | 15.9 | |
| XGBoostConfiguration=Tuned + Ensembled (T+E), Train time per 1K [s]=884.18, Predict time per 1K [s]=2.372026.05 | 1,326 | 0 | 16.5 | |
| CatBoostConfiguration=Default (D), Train time per 1K [s]=9.64, Predict time per 1K [s]=0.132026.05 | 1,312 | 0.1 | 16.9 | |
| XGBoostConfiguration=Tuned (T), Train time per 1K [s]=884.18, Predict time per 1K [s]=0.392026.05 | 1,309 | 0 | 16.7 | |
| TabMConfiguration=Default (D), Train time per 1K [s]=13.18, Predict time per 1K [s]=0.172026.05 | 1,296 | 0.2 | 17 | |
| RealMLPConfiguration=Default (D), Train time per 1K [s]=15.69, Predict time per 1K [s]=4.692026.05 | 1,224 | 0.1 | 18.5 | |
| LightGBMConfiguration=Default (D), Train time per 1K [s]=3.61, Predict time per 1K [s]=0.172026.05 | 1,169 | 0 | 19.9 | |
| XGBoostConfiguration=Default (D), Train time per 1K [s]=3.29, Predict time per 1K [s]=0.252026.05 | 1,165 | 0 | 19.9 |