Predicting Transformer Generalization on MNIST-Transformers 60% threshold
0.897Kendall's tauTransformer-NFN large
Evaluation results
| Method | Links | |
|---|---|---|
| Transformer-NFN largeExtra Parameters (%)=57.66% params ++, Number of runs=52026.04 | 0.897 | |
| Transformer-NFN QuasiExtra Parameters (%)=4.54% params ++, Number of runs=52026.04 | 0.897 | |
| Transformer-NFNNumber of runs=52026.04 | 0.895 | |
| MLPNumber of runs=52026.04 | 0.874 | |
| STATNNNumber of runs=52026.04 | 0.86 | |
| XGBoostNumber of runs=52026.04 | 0.846 | |
| LightGBMNumber of runs=52026.04 | 0.822 | |
| Random ForestNumber of runs=52026.04 | 0.752 |