Tool Retrieval on Toolink
0.5796NDCG@10MFTR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MFTRBackbone=E5-Large2026.02 | 0.5796 | 65.09 | |
| MFTRBackbone=BGE-Large2026.02 | 0.5725 | 64.89 | |
| MFTRBackbone=GTE-Large2026.02 | 0.5602 | 61.3 | |
| MFTRBackbone=BM252026.02 | 0.5497 | 62 | |
| MFTRBackbone=Contriever2026.02 | 0.5493 | 61.37 | |
| MFTRBackbone=COLT2026.02 | 0.5479 | 62.14 | |
| EasyToolBackbone=COLT2026.02 | 0.5378 | 59.22 | |
| MFTRBackbone=MiniLM-L62026.02 | 0.5334 | 60.7 | |
| MFTRBackbone=E5-Base2026.02 | 0.5314 | 59.36 | |
| EasyToolBackbone=Contriever2026.02 | 0.5052 | 52.68 | |
| MFTRBackbone=API Retriever2026.02 | 0.4964 | 54.93 | |
| EasyToolBackbone=BM252026.02 | 0.4899 | 53.69 | |
| EasyToolBackbone=BGE-Large2026.02 | 0.4643 | 51.88 | |
| OnlineRAGBackbone=MiniLM-L62026.02 | 0.459 | 52.58 | |
| EasyToolBackbone=MiniLM-L62026.02 | 0.4279 | 45.99 | |
| OnlineRAGBackbone=BGE-Large2026.02 | 0.4232 | 63.25 | |
| EasyToolBackbone=E5-Base2026.02 | 0.4219 | 50.47 | |
| Full-DocBackbone=BGE-Large2026.02 | 0.4213 | 48.05 | |
| Full-DocBackbone=COLT2026.02 | 0.4023 | 42.76 | |
| Full-DocBackbone=E5-Large2026.02 | 0.3992 | 45.24 | |
| PLUToBackbone=MiniLM-L62026.02 | 0.3926 | 44.5 | |
| Full-DocBackbone=GTE-Large2026.02 | 0.3914 | 42.72 | |
| PLUToBackbone=Contriever2026.02 | 0.3859 | 40.96 | |
| Full-DocBackbone=BM252026.02 | 0.3828 | 44.23 | |
| EasyToolBackbone=E5-Large2026.02 | 0.3824 | 43.48 | |
| Full-DocBackbone=MiniLM-L62026.02 | 0.3818 | 43.08 | |
| Full-DocBackbone=Contriever2026.02 | 0.3809 | 40.26 | |
| Full-DocBackbone=E5-Base2026.02 | 0.3779 | 48.05 | |
| PLUToBackbone=GTE-Large2026.02 | 0.3761 | 41.84 | |
| OnlineRAGBackbone=E5-Base2026.02 | 0.3676 | 54.02 | |
| OnlineRAGBackbone=GTE-Large2026.02 | 0.3672 | 54.26 | |
| PLUToBackbone=BM252026.02 | 0.3661 | 40.01 | |
| PLUToBackbone=COLT2026.02 | 0.3631 | 41.37 | |
| OnlineRAGBackbone=E5-Large2026.02 | 0.3542 | 51.04 | |
| PLUToBackbone=BGE-Large2026.02 | 0.349 | 39.01 | |
| OnlineRAGBackbone=Contriever2026.02 | 0.3455 | 49.92 | |
| EasyToolBackbone=GTE-Large2026.02 | 0.3387 | 37.49 | |
| PLUToBackbone=E5-Base2026.02 | 0.3263 | 35.84 | |
| EasyToolBackbone=API Retriever2026.02 | 0.3057 | 43.11 | |
| OnlineRAGBackbone=API Retriever2026.02 | 0.3052 | 38.5 | |
| PLUToBackbone=E5-Large2026.02 | 0.3012 | 33.96 | |
| PLUToBackbone=API Retriever2026.02 | 0.2954 | 31.61 | |
| Full-DocBackbone=API Retriever2026.02 | 0.2727 | 36.18 | |
| OnlineRAGBackbone=COLT2026.02 | 0.1994 | 23.41 |