Tool Error Detection on GTM Error Detection
95.3Detection RateGTM-1.5B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GTM-1.5BModel Size=1.5B2025.12 | 95.3 | 87.5 | 86.1 | |
| InternLM2.5-1.8BModel Size=1.8B2025.12 | 91 | 25.9 | 24.2 | |
| Qwen2.5-7B-InstructModel Size=7B2025.12 | 89 | 69.3 | 64.7 | |
| Llama-3.2-3B-InstructModel Size=3B2025.12 | 87.2 | 62 | 57.5 | |
| InternLM2.5-7BModel Size=7B2025.12 | 86.5 | 35.4 | 31.8 | |
| InternLM2.5-20BModel Size=20B2025.12 | 86.5 | 65.9 | 58.1 | |
| Qwen2.5-14B-InstructModel Size=14B2025.12 | 85.2 | 81.6 | 74.6 | |
| Qwen2.5-1.5B-InstructModel Size=1.5B2025.12 | 82.1 | 47 | 40.2 | |
| Qwen2.5-3B-InstructModel Size=3B2025.12 | 81.2 | 47 | 40.7 | |
| Llama-3.2-1B-InstructModel Size=1B2025.12 | 80.1 | 23.2 | 20.6 | |
| Qwen2.5-0.5B-InstructModel Size=0.5B2025.12 | 76.8 | 30.3 | 23.9 |