Zero-shot Performance Prediction on GLUE FlexiBERT search space (500 models) (aggregate)
0.711Spearman CorrelationSWAP-Score
Evaluation results
| Method | Links | |
|---|---|---|
| SWAP-Scoremodel_family=BERT-like Transformers, proxy_type=zero-shot2026.05 | 0.711 | |
| Attention Confidencemodel_family=BERT-like Transformers, proxy_type=zero-shot2026.05 | 0.666 | |
| #Paramsmodel_family=BERT-like Transformers, proxy_type=zero-shot2026.05 | 0.653 | |
| #FLOPsmodel_family=BERT-like Transformers, proxy_type=zero-shot2026.05 | 0.652 | |
| Synaptic Saliencymodel_family=BERT-like Transformers, proxy_type=zero-shot2026.05 | 0.177 | |
| Synaptic Diversitymodel_family=BERT-like Transformers, proxy_type=zero-shot2026.05 | 0.169 | |
| Attention Importancemodel_family=BERT-like Transformers, proxy_type=zero-shot2026.05 | 0.162 | |
| Attention Softmax Confidencemodel_family=BERT-like Transformers, proxy_type=zero-shot2026.05 | 0.055 | |
| Activation Distancemodel_family=BERT-like Transformers, proxy_type=zero-shot2026.05 | 0.031 | |
| Jacobian Scoremodel_family=BERT-like Transformers, proxy_type=zero-shot2026.05 | 0.016 | |
| DSS-Indicatormodel_family=BERT-like Transformers, proxy_type=zero-shot2026.05 | -0.071 |