Predicting Transformer Generalization on AGNews-Transformers (80% threshold)
0.896Kendall's tauTransformer-NFN Quasi
Evaluation Results
| Method | Links | |
|---|---|---|
| Transformer-NFN QuasiExtra Parameters (%)=5.27% params ++, Number of runs=52026.04 | 0.896 | |
| Transformer-NFN largeExtra Parameters (%)=59.38% params ++, Number of runs=52026.04 | 0.893 | |
| Transformer-NFNNumber of runs=52026.04 | 0.89 | |
| XGBoostNumber of runs=52026.04 | 0.872 | |
| MLPNumber of runs=52026.04 | 0.862 | |
| LightGBMNumber of runs=52026.04 | 0.82 | |
| STATNNNumber of runs=52026.04 | 0.812 | |
| Random ForestNumber of runs=52026.04 | 0.773 |