Performance Estimation on Open LLM Leaderboard subset-selection
1.4MAERandom
Evaluation results
| Method | Links | |
|---|---|---|
| RandomSubset=2.0%2025.10 | 1.4 | |
| Scales++Subset=2.0%2025.10 | 1.4 | |
| IRT ClusteringSubset=2.0%2025.10 | 1.5 | |
| Scales++ LiteSubset=2.0%2025.10 | 1.5 | |
| Scales++Subset=1.0%2025.10 | 1.9 | |
| IRT ClusteringSubset=1.0%2025.10 | 2 | |
| RandomSubset=1.0%2025.10 | 2.1 | |
| Scales++ LiteSubset=1.0%2025.10 | 2.3 | |
| Scales++ LiteSubset=0.5%2025.10 | 2.4 | |
| gp-IRTSubset=2.0%2025.10 | 2.5 | |
| RandomSubset=0.5%2025.10 | 2.7 | |
| gp-IRTSubset=1.0%2025.10 | 2.7 | |
| IRT ClusteringSubset=0.5%2025.10 | 2.8 | |
| Scales++Subset=0.5%2025.10 | 2.8 | |
| gp-IRTSubset=0.5%2025.10 | 3 | |
| Scales++Subset=0.25%2025.10 | 3.2 | |
| gp-IRTSubset=0.25%2025.10 | 3.5 | |
| Scales++ LiteSubset=0.25%2025.10 | 3.6 | |
| IRT ClusteringSubset=0.25%2025.10 | 3.8 | |
| RandomSubset=0.25%2025.10 | 4.2 | |
| p-IRTSubset=0.25%2025.10 | 6.2 | |
| p-IRTSubset=0.5%2025.10 | 7.6 | |
| p-IRTSubset=1.0%2025.10 | 7.7 | |
| p-IRTSubset=2.0%2025.10 | 8.1 |