Tool Planning on GTA
79.26Tool Selection F1 (Step-by-step)ToolTree
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ToolTreeModel=GPT-4o2026.03 | 79.26 | 50.84 | 85.53 | 52.17 | 66.95 | |
| LATSModel=GPT-4o2026.03 | 77.84 | 49.9 | 82.57 | 48.8 | 64.78 | |
| A*Model=GPT-4o2026.03 | 74.29 | 47.58 | 79.96 | 46.26 | 62.52 | |
| ToTModel=GPT-4o2026.03 | 72.53 | 43.68 | 78.84 | 46.53 | 60.4 | |
| Best-FirstModel=GPT-4o2026.03 | 72.13 | 44.26 | 77.64 | 47.83 | 60.46 | |
| ReActModel=GPT-4o2026.03 | 71.42 | 40.58 | 75.52 | 46.33 | 58.46 | |
| Zero-shotModel=GPT-4o2026.03 | 70.16 | 38.52 | 77.14 | 45.28 | 57.78 | |
| ToolTreeModel=GPT-4o-mini2026.03 | 67.83 | 39.64 | 76.44 | 39.65 | 55.89 | |
| CoTModel=GPT-4o2026.03 | 66.52 | 42.17 | 73.22 | 42.86 | 56.69 | |
| LATSModel=GPT-4o-mini2026.03 | 65.88 | 37.26 | 74.28 | 38.24 | 53.91 | |
| A*Model=GPT-4o-mini2026.03 | 64.47 | 35.26 | 73.86 | 38.16 | 52.94 | |
| ToTModel=GPT-4o-mini2026.03 | 62.41 | 33.12 | 72.94 | 37.42 | 51.47 | |
| ReActModel=GPT-4o-mini2026.03 | 60.13 | 29.43 | 68.26 | 34.8 | 48.16 | |
| Zero-ShotModel=GPT-4o-mini2026.03 | 58.73 | 28.44 | 60.18 | 33.85 | 45.3 | |
| Best-FirstModel=GPT-4o-mini2026.03 | 58.42 | 30.13 | 69.96 | 34.46 | 47.99 | |
| CoTModel=GPT-4o-mini2026.03 | 56.1 | 25.58 | 66.47 | 35.63 | 45.95 |