Predicting Transformer Generalization on AGNews Transformers (40% threshold)
0.901Kendall's TauTransformer-NFN Quasi
Evaluation Results
| Method | Links | |
|---|---|---|
| Transformer-NFN QuasiExtra Parameters (%)=5.27% params ++, Number of runs=52026.04 | 0.901 | |
| Transformer-NFN largeExtra Parameters (%)=59.38% params ++, Number of runs=52026.04 | 0.898 | |
| Transformer-NFNNumber of runs=52026.04 | 0.897 | |
| XGBoostNumber of runs=52026.04 | 0.872 | |
| MLPNumber of runs=52026.04 | 0.841 | |
| LightGBMNumber of runs=52026.04 | 0.837 | |
| STATNNNumber of runs=52026.04 | 0.812 | |
| Random ForestNumber of runs=52026.04 | 0.797 |