LLM Performance Estimation on GSM8K (test)
1.619MAE (%)SparseEval
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SparseEvalNumber of Anchors=1002026.02 | 1.619 | 0.936 | |
| SparseEvalNumber of Anchors=802026.02 | 1.754 | 0.931 | |
| SparseEvalNumber of Anchors=602026.02 | 1.96 | 0.925 | |
| SparseEvalNumber of Anchors=402026.02 | 2.321 | 0.908 | |
| gp-IRTNumber of Anchors=1002026.02 | 2.424 | 0.887 | |
| gp-IRTNumber of Anchors=802026.02 | 2.774 | 0.88 | |
| Anchor PointsNumber of Anchors=802026.02 | 2.778 | 0.906 | |
| gp-IRTNumber of Anchors=602026.02 | 3.161 | 0.871 | |
| SparseEvalNumber of Anchors=202026.02 | 3.305 | 0.872 | |
| Anchor PointsNumber of Anchors=602026.02 | 3.631 | 0.916 | |
| Anchor PointsNumber of Anchors=402026.02 | 3.756 | 0.878 | |
| gp-IRTNumber of Anchors=402026.02 | 3.984 | 0.832 | |
| TailoredBenchNumber of Anchors=802026.02 | 4.003 | 0.9 | |
| TailoredBenchNumber of Anchors=402026.02 | 4.157 | 0.885 | |
| TailoredBenchNumber of Anchors=1002026.02 | 4.203 | 0.912 | |
| TailoredBenchNumber of Anchors=602026.02 | 4.271 | 0.892 | |
| Anchor PointsNumber of Anchors=202026.02 | 4.433 | 0.844 | |
| gp-IRTNumber of Anchors=202026.02 | 5.275 | 0.802 | |
| Anchor PointsNumber of Anchors=1002026.02 | 5.295 | 0.842 | |
| TailoredBenchNumber of Anchors=202026.02 | 5.412 | 0.833 |