Tool Planning on RestBench TMDB
72.4Pass RateToolTree
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ToolTreeModel=GPT-4o2026.03 | 72.4 | 75.59 | 74.5 | |
| LATSModel=GPT-4o2026.03 | 68.26 | 74.44 | 71.35 | |
| DFSDTModel=GPT-4o2026.03 | 66.57 | 69.08 | 67.82 | |
| ReActModel=GPT-4o2026.03 | 62.42 | 66.17 | 64.3 | |
| CoTModel=GPT-4o2026.03 | 58.52 | 52.32 | 55.42 | |
| Zero-shotModel=GPT-4o2026.03 | 56.28 | 50 | 53.14 | |
| ToolTreeModel=GPT-4o-mini2026.03 | 55.17 | 70.4 | 62.79 | |
| LATSModel=GPT-4o-mini2026.03 | 51.33 | 66.67 | 59 | |
| DFSDTModel=GPT-4o-mini2026.03 | 46.2 | 64.26 | 55.23 | |
| ReActModel=GPT-4o-mini2026.03 | 38.82 | 61.06 | 49.94 | |
| CoTModel=GPT-4o-mini2026.03 | 34.42 | 54.7 | 44.56 | |
| Zero-shotModel=GPT-4o-mini2026.03 | 33.28 | 50 | 41.64 |