Tool Retrieval on publicMCP EN v1.0 (test)
100Hit RateA2X
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| A2XK=-2026.05 | 100 | 94.9 | 10.5 | |
| MiniLMK=102026.05 | 80 | 49.8 | 13 | |
| MiniLMK=52026.05 | 72 | 41.1 | 21.2 | |
| BGE-large-enK=102026.05 | 70 | 40.5 | 11 | |
| BGE-M3K=102026.05 | 70 | 41.8 | 11.4 | |
| BGE-M3K=52026.05 | 66 | 35.4 | 18.8 | |
| BGE-large-enK=52026.05 | 60 | 32.7 | 17.6 | |
| MCP-ZeroK=52026.05 | 54 | 24.7 | 14.4 | |
| MCP-ZeroK=102026.05 | 52 | 27.5 | 7.6 |