Tool Retrieval on ToolBench
58.54NDCG@10MFTR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MFTRBackbone=API Retriever2026.02 | 58.54 | 67.43 | |
| MFTRBackbone=E5-Large2026.02 | 56.06 | 63.59 | |
| MFTRBackbone=BM252026.02 | 55.73 | 62.7 | |
| MFTRBackbone=BGE-Large2026.02 | 55.44 | 63.47 | |
| EasyToolBackbone=E5-Large2026.02 | 55.26 | 62.81 | |
| MFTRBackbone=E5-Base2026.02 | 55.2 | 62.95 | |
| EasyToolBackbone=API Retriever2026.02 | 55.15 | 62.03 | |
| OnlineRAGBackbone=COLT2026.02 | 54.37 | 62.53 | |
| OnlineRAGBackbone=API Retriever2026.02 | 54.24 | 61.15 | |
| MFTRBackbone=MiniLM-L62026.02 | 54.12 | 62.56 | |
| EasyToolBackbone=COLT2026.02 | 53.78 | 63.51 | |
| MFTRBackbone=GTE-Large2026.02 | 53.48 | 61.11 | |
| OnlineRAGBackbone=E5-Large2026.02 | 53.46 | 60.28 | |
| EasyToolBackbone=E5-Base2026.02 | 53.09 | 60.85 | |
| MFTRBackbone=Contriever2026.02 | 52.75 | 61.03 | |
| OnlineRAGBackbone=E5-Base2026.02 | 52.65 | 59.28 | |
| EasyToolBackbone=BM252026.02 | 52.45 | 60.15 | |
| EasyToolBackbone=GTE-Large2026.02 | 51.38 | 59.84 | |
| MFTRBackbone=COLT2026.02 | 50.11 | 58.36 | |
| Full-DocBackbone=API Retriever2026.02 | 49.44 | 57.03 | |
| EasyToolBackbone=BGE-Large2026.02 | 49 | 56.57 | |
| OnlineRAGBackbone=BGE-Large2026.02 | 47.8 | 54.66 | |
| Full-DocBackbone=E5-Base2026.02 | 47.22 | 54.4 | |
| OnlineRAGBackbone=Contriever2026.02 | 46.77 | 53.73 | |
| EasyToolBackbone=Contriever2026.02 | 45.93 | 54.62 | |
| Full-DocBackbone=E5-Large2026.02 | 45.77 | 52.05 | |
| Full-DocBackbone=GTE-Large2026.02 | 44.44 | 52.21 | |
| EasyToolBackbone=MiniLM-L62026.02 | 43.06 | 51.22 | |
| OnlineRAGBackbone=GTE-Large2026.02 | 42.94 | 51.35 | |
| OnlineRAGBackbone=MiniLM-L62026.02 | 41.39 | 48.21 | |
| Full-DocBackbone=COLT2026.02 | 41.1 | 49.05 | |
| Full-DocBackbone=BGE-Large2026.02 | 39.82 | 47.94 | |
| PLUToBackbone=API Retriever2026.02 | 39.34 | 54.61 | |
| Full-DocBackbone=BM252026.02 | 37 | 43.06 | |
| Full-DocBackbone=Contriever2026.02 | 36.01 | 42.21 | |
| PLUToBackbone=BGE-Large2026.02 | 35.87 | 48.14 | |
| PLUToBackbone=COLT2026.02 | 35.36 | 48.76 | |
| PLUToBackbone=MiniLM-L62026.02 | 34.86 | 44.07 | |
| PLUToBackbone=GTE-Large2026.02 | 34.74 | 45.67 | |
| PLUToBackbone=Contriever2026.02 | 34.45 | 43.2 | |
| PLUToBackbone=E5-Large2026.02 | 34.2 | 40.94 | |
| PLUToBackbone=E5-Base2026.02 | 33.15 | 42.93 | |
| PLUToBackbone=BM252026.02 | 28.44 | 37.54 | |
| Full-DocBackbone=MiniLM-L62026.02 | 27.9 | 34.32 |