Tool Retrieval on ToolRet CN v1.0 (test)
98HRA2X
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| A2XK=-2026.05 | 98 | 88.9 | 9.9 | |
| A2XK=-2026.05 | 90.3 | 86.4 | 12 | |
| A2XK=52026.05 | 90.3 | 86.4 | — | |
| BGE-M3K=102026.05 | 74 | 43.3 | 11.8 | |
| BGE-M3K=102026.05 | 71.4 | 64.9 | 8.2 | |
| MCP-ZeroK=102026.05 | 62.2 | 56 | 6.9 | |
| BGE-M3K=52026.05 | 60.9 | 54.4 | 13.5 | |
| BGE-M3K=52026.05 | 60.9 | 54.4 | — | |
| MCP-ZeroK=52026.05 | 58.6 | 52.4 | 12.8 | |
| MCP-ZeroK=52026.05 | 58.6 | 52.4 | — | |
| BGE-M3K=52026.05 | 58 | 29.1 | 16 | |
| text2vec-base-chineseK=102026.05 | 49.6 | 44.3 | 5.4 | |
| MCP-ZeroK=102026.05 | 48 | 23.3 | 7 | |
| text2vec-base-chineseK=52026.05 | 41.4 | 36.9 | 8.9 | |
| text2vec-base-chineseK=52026.05 | 41.4 | 36.9 | — | |
| MCP-ZeroK=52026.05 | 40 | 18.7 | 10.8 | |
| text2vec-base-chineseK=102026.05 | 28 | 11.4 | 3.2 | |
| text2vec-base-chineseK=52026.05 | 20 | 7.6 | 4.4 |