Tool Planning on m&m
91.92Tool Selection F1 (Step-by-step)ToolTree
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ToolTreeModel=GPT-4o2026.03 | 91.92 | 86.16 | 90.47 | 85.88 | 88.61 | |
| LATSModel=GPT-4o2026.03 | 88.89 | 84.77 | 88.38 | 83.77 | 86.45 | |
| A*Model=GPT-4o2026.03 | 87.17 | 83.44 | 86.87 | 81.49 | 84.74 | |
| ToTModel=GPT-4o2026.03 | 86.28 | 83.74 | 85.26 | 80.35 | 83.91 | |
| CoTModel=GPT-4o2026.03 | 85.58 | 77.84 | 78.16 | 71.43 | 78.75 | |
| Best-FirstModel=GPT-4o2026.03 | 84.47 | 82.17 | 85.84 | 78.11 | 82.65 | |
| ReActModel=GPT-4o2026.03 | 83.58 | 81.24 | 84.42 | 76.58 | 81.46 | |
| Zero-shotModel=GPT-4o2026.03 | 78.52 | 80.17 | 85.17 | 78.47 | 80.58 | |
| ToolTreeModel=GPT-4o-mini2026.03 | 77.25 | 71.26 | 85.52 | 73.58 | 76.9 | |
| LATSModel=GPT-4o-mini2026.03 | 76.84 | 70.16 | 83.38 | 72.94 | 75.83 | |
| ToTModel=GPT-4o-mini2026.03 | 75.58 | 70.84 | 82.58 | 71.37 | 75.59 | |
| A*Model=GPT-4o-mini2026.03 | 75.16 | 71.85 | 84.74 | 72.59 | 76.59 | |
| Best-FirstModel=GPT-4o-mini2026.03 | 74.42 | 66.83 | 83.58 | 68.37 | 73.8 | |
| ReActModel=GPT-4o-mini2026.03 | 73.55 | 65.1 | 82.16 | 69.42 | 72.56 | |
| Zero-ShotModel=GPT-4o-mini2026.03 | 72.48 | 67.44 | 77.48 | 67.59 | 71.25 | |
| CoTModel=GPT-4o-mini2026.03 | 70.13 | 65.27 | 76.12 | 66.96 | 69.62 |