LLM Performance Estimation on HellaSwag (test)
0.827MAE (%)SparseEval
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SparseEvalNumber of Anchors=1002026.02 | 0.827 | 0.918 | |
| SparseEvalNumber of Anchors=802026.02 | 0.942 | 0.91 | |
| SparseEvalNumber of Anchors=602026.02 | 0.993 | 0.906 | |
| SparseEvalNumber of Anchors=402026.02 | 1.21 | 0.89 | |
| SparseEvalNumber of Anchors=202026.02 | 1.477 | 0.857 | |
| gp-IRTNumber of Anchors=1002026.02 | 1.75 | 0.783 | |
| TailoredBenchNumber of Anchors=602026.02 | 1.868 | 0.861 | |
| TailoredBenchNumber of Anchors=802026.02 | 1.957 | 0.857 | |
| Anchor PointsNumber of Anchors=802026.02 | 1.962 | 0.847 | |
| TailoredBenchNumber of Anchors=1002026.02 | 1.968 | 0.876 | |
| gp-IRTNumber of Anchors=802026.02 | 1.992 | 0.784 | |
| Anchor PointsNumber of Anchors=1002026.02 | 2.012 | 0.889 | |
| TailoredBenchNumber of Anchors=402026.02 | 2.257 | 0.847 | |
| TailoredBenchNumber of Anchors=202026.02 | 2.352 | 0.811 | |
| Anchor PointsNumber of Anchors=602026.02 | 2.416 | 0.856 | |
| Anchor PointsNumber of Anchors=402026.02 | 2.619 | 0.875 | |
| gp-IRTNumber of Anchors=602026.02 | 2.754 | 0.745 | |
| Anchor PointsNumber of Anchors=202026.02 | 3.272 | 0.796 | |
| gp-IRTNumber of Anchors=402026.02 | 3.501 | 0.687 | |
| gp-IRTNumber of Anchors=202026.02 | 5.323 | 0.661 |