LLM Performance Estimation on TruthfulQA (test)
1.027MAE (%)SparseEval
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SparseEvalNumber of Anchors=1002026.02 | 1.027 | 0.931 | |
| SparseEvalNumber of Anchors=802026.02 | 1.083 | 0.922 | |
| SparseEvalNumber of Anchors=602026.02 | 1.243 | 0.911 | |
| TailoredBenchNumber of Anchors=1002026.02 | 1.577 | 0.895 | |
| SparseEvalNumber of Anchors=402026.02 | 1.589 | 0.886 | |
| TailoredBenchNumber of Anchors=802026.02 | 1.718 | 0.874 | |
| Anchor PointsNumber of Anchors=1002026.02 | 1.733 | 0.891 | |
| SparseEvalNumber of Anchors=202026.02 | 1.756 | 0.878 | |
| Anchor PointsNumber of Anchors=802026.02 | 1.758 | 0.885 | |
| gp-IRTNumber of Anchors=1002026.02 | 1.808 | 0.847 | |
| TailoredBenchNumber of Anchors=602026.02 | 1.928 | 0.863 | |
| Anchor PointsNumber of Anchors=602026.02 | 1.958 | 0.87 | |
| gp-IRTNumber of Anchors=802026.02 | 1.973 | 0.836 | |
| TailoredBenchNumber of Anchors=402026.02 | 2.105 | 0.855 | |
| gp-IRTNumber of Anchors=602026.02 | 2.25 | 0.823 | |
| Anchor PointsNumber of Anchors=402026.02 | 2.443 | 0.838 | |
| TailoredBenchNumber of Anchors=202026.02 | 2.554 | 0.847 | |
| gp-IRTNumber of Anchors=402026.02 | 3.032 | 0.771 | |
| Anchor PointsNumber of Anchors=202026.02 | 3.215 | 0.803 | |
| gp-IRTNumber of Anchors=202026.02 | 4.452 | 0.712 |