Predicting Transformer Generalization on AGNews Transformers (60% threshold)
0.903Kendall's tauTransformer-NFN Quasi
Evaluation Results
| Method | Links | |
|---|---|---|
| Transformer-NFN QuasiExtra Parameters (%)=5.27% params ++, Number of runs=52026.04 | 0.903 | |
| Transformer-NFN largeExtra Parameters (%)=59.38% params ++, Number of runs=52026.04 | 0.898 | |
| Transformer-NFNNumber of runs=52026.04 | 0.896 | |
| XGBoostNumber of runs=52026.04 | 0.874 | |
| MLPNumber of runs=52026.04 | 0.842 | |
| LightGBMNumber of runs=52026.04 | 0.835 | |
| STATNNNumber of runs=52026.04 | 0.813 | |
| Random ForestNumber of runs=52026.04 | 0.798 |