Tool Retrieval on APIGen
0.8575NDCG@10MFTR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MFTRBackbone=BGE-Large2026.02 | 0.8575 | 93.08 | |
| MFTRBackbone=E5-Large2026.02 | 0.8556 | 93.02 | |
| MFTRBackbone=MiniLM-L62026.02 | 0.8516 | 92.48 | |
| MFTRBackbone=E5-Base2026.02 | 0.8516 | 92.63 | |
| MFTRBackbone=GTE-Large2026.02 | 0.8476 | 92.72 | |
| MFTRBackbone=COLT2026.02 | 0.846 | 92.16 | |
| MFTRBackbone=BM252026.02 | 0.843 | 92.28 | |
| MFTRBackbone=Contriever2026.02 | 0.8365 | 91.27 | |
| MFTRBackbone=API Retriever2026.02 | 0.8364 | 91.63 | |
| EasyToolBackbone=COLT2026.02 | 0.7953 | 89 | |
| EasyToolBackbone=BM252026.02 | 0.7928 | 88.82 | |
| Full-DocBackbone=COLT2026.02 | 0.7846 | 88.9 | |
| OnlineRAGBackbone=BGE-Large2026.02 | 0.7794 | 88.35 | |
| EasyToolBackbone=E5-Large2026.02 | 0.7774 | 87.08 | |
| Full-DocBackbone=BGE-Large2026.02 | 0.7748 | 86.62 | |
| OnlineRAGBackbone=COLT2026.02 | 0.7739 | 87.65 | |
| EasyToolBackbone=GTE-Large2026.02 | 0.7577 | 86.19 | |
| Full-DocBackbone=BM252026.02 | 0.7571 | 85.79 | |
| EasyToolBackbone=E5-Base2026.02 | 0.7538 | 85.85 | |
| OnlineRAGBackbone=Contriever2026.02 | 0.7532 | 85.39 | |
| Full-DocBackbone=E5-Large2026.02 | 0.7442 | 84.3 | |
| EasyToolBackbone=API Retriever2026.02 | 0.742 | 83.15 | |
| OnlineRAGBackbone=API Retriever2026.02 | 0.7367 | 82.74 | |
| EasyToolBackbone=Contriever2026.02 | 0.7361 | 83.55 | |
| Full-DocBackbone=E5-Base2026.02 | 0.7359 | 83.58 | |
| EasyToolBackbone=BGE-Large2026.02 | 0.7355 | 84.08 | |
| Full-DocBackbone=API Retriever2026.02 | 0.727 | 82.15 | |
| OnlineRAGBackbone=MiniLM-L62026.02 | 0.724 | 82.81 | |
| EasyToolBackbone=MiniLM-L62026.02 | 0.7193 | 83.59 | |
| Full-DocBackbone=MiniLM-L62026.02 | 0.7126 | 81.78 | |
| Full-DocBackbone=Contriever2026.02 | 0.7096 | 81.78 | |
| OnlineRAGBackbone=GTE-Large2026.02 | 0.6984 | 81.45 | |
| Full-DocBackbone=GTE-Large2026.02 | 0.6931 | 80.61 | |
| PLUToBackbone=Contriever2026.02 | 0.574 | 72.42 | |
| PLUToBackbone=MiniLM-L62026.02 | 0.568 | 71.81 | |
| PLUToBackbone=BGE-Large2026.02 | 0.5634 | 72.17 | |
| PLUToBackbone=GTE-Large2026.02 | 0.56 | 70.94 | |
| PLUToBackbone=E5-Large2026.02 | 0.5597 | 73.25 | |
| PLUToBackbone=E5-Base2026.02 | 0.5534 | 72.85 | |
| PLUToBackbone=API Retriever2026.02 | 0.5392 | 74.82 | |
| PLUToBackbone=BM252026.02 | 0.5328 | 73.92 | |
| OnlineRAGBackbone=E5-Large2026.02 | 0.5282 | 88.15 | |
| PLUToBackbone=COLT2026.02 | 0.5254 | 74.64 | |
| OnlineRAGBackbone=E5-Base2026.02 | 0.514 | 85.56 |