Predicting Transformer Generalization on AGNews Transformers 20% threshold
0.913Kendall's tauTransformer-NFN Quasi
Evaluation Results
| Method | Links | |
|---|---|---|
| Transformer-NFN QuasiExtra Parameters (%)=5.27% params ++, Number of runs=52026.04 | 0.913 | |
| Transformer-NFN largeExtra Parameters (%)=59.38% params ++, Number of runs=52026.04 | 0.91 | |
| Transformer-NFNNumber of runs=52026.04 | 0.908 | |
| MLPNumber of runs=52026.04 | 0.875 | |
| XGBoostNumber of runs=52026.04 | 0.852 | |
| LightGBMNumber of runs=52026.04 | 0.845 | |
| STATNNNumber of runs=52026.04 | 0.839 | |
| Random ForestNumber of runs=52026.04 | 0.801 |