LLM Performance Estimation on ARC (test)
1.165MAE (%)SparseEval
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SparseEvalNumber of Anchors=1002026.02 | 1.165 | 0.917 | |
| SparseEvalNumber of Anchors=802026.02 | 1.227 | 0.91 | |
| SparseEvalNumber of Anchors=602026.02 | 1.404 | 0.902 | |
| SparseEvalNumber of Anchors=402026.02 | 1.581 | 0.883 | |
| SparseEvalNumber of Anchors=202026.02 | 1.778 | 0.863 | |
| gp-IRTNumber of Anchors=1002026.02 | 2.274 | 0.787 | |
| Anchor PointsNumber of Anchors=802026.02 | 2.289 | 0.868 | |
| Anchor PointsNumber of Anchors=402026.02 | 2.375 | 0.866 | |
| TailoredBenchNumber of Anchors=1002026.02 | 2.413 | 0.873 | |
| TailoredBenchNumber of Anchors=602026.02 | 2.448 | 0.852 | |
| gp-IRTNumber of Anchors=802026.02 | 2.612 | 0.761 | |
| TailoredBenchNumber of Anchors=402026.02 | 2.646 | 0.854 | |
| TailoredBenchNumber of Anchors=802026.02 | 2.816 | 0.862 | |
| Anchor PointsNumber of Anchors=602026.02 | 2.89 | 0.867 | |
| gp-IRTNumber of Anchors=602026.02 | 2.959 | 0.758 | |
| TailoredBenchNumber of Anchors=202026.02 | 3.426 | 0.824 | |
| gp-IRTNumber of Anchors=402026.02 | 3.642 | 0.698 | |
| Anchor PointsNumber of Anchors=202026.02 | 4.004 | 0.769 | |
| gp-IRTNumber of Anchors=202026.02 | 5.332 | 0.641 | |
| Anchor PointsNumber of Anchors=1002026.02 | 10.62 | 0.578 |