# Tool Retrieval on ToolRet CN v1.0 (test) Source: [Tool Retrieval on ToolRet CN v1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-05-29T08:23:01.183Z Evaluation of model performance on the Tool Retrieval task using the test split of the ToolRet CN v1.0 dataset, measured by HR, Recall, and Precision. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Tool Retrieval | | Dataset (including any stated split) | ToolRet CN v1.0 (test) | | Metric | HR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [HR](): Higher is better; unit: PERCENT. - [Recall](): Higher is better; unit: PERCENT. - [Precision](): Higher is better; unit: PERCENT. ## Recorded results | Method | HR | Result date | Report paper | | --- | --- | --- | --- | | A2X | 98 | Not recorded | 6a191dacdbd7150506f8290d | | A2X | 90.3 | Not recorded | 6a191dacdbd7150506f8290d | | A2X | 90.3 | Not recorded | 6a191dacdbd7150506f8290d | | BGE-M3 | 74 | Not recorded | 6a191dacdbd7150506f8290d | | BGE-M3 | 71.4 | Not recorded | 6a191dacdbd7150506f8290d | | MCP-Zero | 62.2 | Not recorded | 6a191dacdbd7150506f8290d | | BGE-M3 | 60.9 | Not recorded | 6a191dacdbd7150506f8290d | | BGE-M3 | 60.9 | Not recorded | 6a191dacdbd7150506f8290d | | MCP-Zero | 58.6 | Not recorded | 6a191dacdbd7150506f8290d | | MCP-Zero | 58.6 | Not recorded | 6a191dacdbd7150506f8290d | | BGE-M3 | 58 | Not recorded | 6a191dacdbd7150506f8290d | | text2vec-base-chinese | 49.6 | Not recorded | 6a191dacdbd7150506f8290d | | MCP-Zero | 48 | Not recorded | 6a191dacdbd7150506f8290d | | text2vec-base-chinese | 41.4 | Not recorded | 6a191dacdbd7150506f8290d | | text2vec-base-chinese | 41.4 | Not recorded | 6a191dacdbd7150506f8290d | | MCP-Zero | 40 | Not recorded | 6a191dacdbd7150506f8290d | | text2vec-base-chinese | 28 | Not recorded | 6a191dacdbd7150506f8290d | | text2vec-base-chinese | 20 | Not recorded | 6a191dacdbd7150506f8290d | ### A2X HR: 98. Result ID: 6a194be4fbc373592c1394d1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"-"}. This record does not assert independent reproduction. ### A2X HR: 90.3. Result ID: 6a194be4fbc373592c1394c1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"-"}. This record does not assert independent reproduction. ### A2X HR: 90.3. Result ID: 6a194be4fbc373592c1394da. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"5"}. This record does not assert independent reproduction. ### BGE-M3 HR: 74. Result ID: 6a194be4fbc373592c1394ce. [Reporting paper]() Recorded evaluation configuration: {"K":"10"}. This record does not assert independent reproduction. ### BGE-M3 HR: 71.4. Result ID: 6a194be4fbc373592c1394be. [Reporting paper]() Recorded evaluation configuration: {"K":"10"}. This record does not assert independent reproduction. ### MCP-Zero HR: 62.2. Result ID: 6a194be4fbc373592c1394c0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"10"}. This record does not assert independent reproduction. ### BGE-M3 HR: 60.9. Result ID: 6a194be4fbc373592c1394bd. [Reporting paper]() Recorded evaluation configuration: {"K":"5"}. This record does not assert independent reproduction. ### BGE-M3 HR: 60.9. Result ID: 6a194be4fbc373592c1394d8. [Reporting paper]() Recorded evaluation configuration: {"K":"5"}. This record does not assert independent reproduction. ### MCP-Zero HR: 58.6. Result ID: 6a194be4fbc373592c1394bf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"5"}. This record does not assert independent reproduction. ### MCP-Zero HR: 58.6. Result ID: 6a194be4fbc373592c1394d9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"5"}. This record does not assert independent reproduction. ### BGE-M3 HR: 58. Result ID: 6a194be4fbc373592c1394cd. [Reporting paper]() Recorded evaluation configuration: {"K":"5"}. This record does not assert independent reproduction. ### text2vec-base-chinese HR: 49.6. Result ID: 6a194be4fbc373592c1394bc. [Reporting paper]() Recorded evaluation configuration: {"K":"10"}. This record does not assert independent reproduction. ### MCP-Zero HR: 48. Result ID: 6a194be4fbc373592c1394d0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"10"}. This record does not assert independent reproduction. ### text2vec-base-chinese HR: 41.4. Result ID: 6a194be4fbc373592c1394bb. [Reporting paper]() Recorded evaluation configuration: {"K":"5"}. This record does not assert independent reproduction. ### text2vec-base-chinese HR: 41.4. Result ID: 6a194be4fbc373592c1394d7. [Reporting paper]() Recorded evaluation configuration: {"K":"5"}. This record does not assert independent reproduction. ### MCP-Zero HR: 40. Result ID: 6a194be4fbc373592c1394cf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"5"}. This record does not assert independent reproduction. ### text2vec-base-chinese HR: 28. Result ID: 6a194be4fbc373592c1394cc. [Reporting paper]() Recorded evaluation configuration: {"K":"10"}. This record does not assert independent reproduction. ### text2vec-base-chinese HR: 20. Result ID: 6a194be4fbc373592c1394cb. [Reporting paper]() Recorded evaluation configuration: {"K":"5"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.