Error Identification on TRAIL GAIA (test)
88.1PrecisionTool Calling
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Tool CallingAbbreviation=TC2025.10 | 88.1 | 40.6 | 55.6 | 45.5 | 70.5 | |
| TC JudgeJudge Type=TC2025.10 | 87.9 | 96.9 | 92.2 | 95 | 92.5 | |
| Tool SelectionAbbreviation=TS2025.10 | 77.9 | 64.4 | 70.5 | 66.7 | 80.1 | |
| LC JudgeJudge Type=LC2025.10 | 76.3 | 82.9 | 79.5 | 81.5 | 78.7 | |
| EE JudgeJudge Type=EE2025.10 | 76 | 93.3 | 83.8 | 89.2 | 84.7 | |
| Execution EfficiencyAbbreviation=EE2025.10 | 75 | 83.2 | 78.9 | 81.4 | 81.1 | |
| Logic ConsistencyAbbreviation=LC2025.10 | 74.8 | 72.1 | 73.5 | 72.7 | 74 | |
| TS JudgeJudge Type=TS2025.10 | 64.7 | 97.1 | 77.7 | 88.3 | 79.4 | |
| Plan AdherenceAbbreviation=PA2025.10 | 62.9 | 86.2 | 72.7 | 80.2 | 85.1 | |
| PA JudgeJudge Type=PA2025.10 | 52.3 | 89.2 | 65.9 | 78.2 | 78.7 | |
| PQ JudgeJudge Type=PQ2025.10 | 37 | 71.4 | 48.8 | 60.2 | 92.5 | |
| Plan QualityAbbreviation=PQ2025.10 | 34.8 | 57.1 | 43.2 | 50.6 | 92.5 |