Tool Retrieval and Invocation on API-Bank Level-3
90.67Recall@kBSCTR
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BSCTRconfiguration=Full2026.04 | 90.67 | 86.13 | 88.04 | 79 | 60.9 | |
| Query Rewriting2026.04 | 89.81 | 85.62 | 87.71 | 77.67 | 59.4 | |
| BSCTRconfiguration=w/o Tool Graph2026.04 | 89.81 | 85.62 | 87.71 | 77.67 | 59.4 | |
| Graph-based2026.04 | 89.67 | 85.71 | 87.69 | 77.67 | 56.83 | |
| Dense2026.04 | 85.67 | 84.1 | 84.89 | 65.67 | 57.1 | |
| BSCTRconfiguration=w/o Planning2026.04 | 85.67 | 83.74 | 84.45 | 64.33 | 55.87 | |
| BM252026.04 | 59 | 66.43 | 62.72 | 41.67 | 37.7 |