Tool Retrieval on Mixed
0.59NDCG@10MFTR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MFTRBackbone=BGE-Large2026.02 | 0.59 | 68.11 | |
| MFTRBackbone=E5-Large2026.02 | 0.5856 | 67 | |
| MFTRBackbone=BM252026.02 | 0.5807 | 66.26 | |
| MFTRBackbone=E5-Base2026.02 | 0.5806 | 65.7 | |
| MFTRBackbone=GTE-Large2026.02 | 0.5634 | 65.53 | |
| MFTRBackbone=Contriever2026.02 | 0.5624 | 64.99 | |
| MFTRBackbone=MiniLM-L62026.02 | 0.5617 | 64.49 | |
| MFTRBackbone=API Retriever2026.02 | 0.5582 | 64.93 | |
| MFTRBackbone=COLT2026.02 | 0.5482 | 63.85 | |
| PLUToBackbone=E5-Large2026.02 | 0.4746 | 58.35 | |
| EasyToolBackbone=BM252026.02 | 0.4668 | 58.69 | |
| PLUToBackbone=BM252026.02 | 0.4667 | 57.15 | |
| PLUToBackbone=GTE-Large2026.02 | 0.4595 | 56.84 | |
| OnlineRAGBackbone=COLT2026.02 | 0.4579 | 55.49 | |
| PLUToBackbone=COLT2026.02 | 0.4568 | 56.02 | |
| PLUToBackbone=E5-Base2026.02 | 0.4555 | 56.28 | |
| PLUToBackbone=BGE-Large2026.02 | 0.453 | 55.46 | |
| PLUToBackbone=Contriever2026.02 | 0.4396 | 54.39 | |
| EasyToolBackbone=COLT2026.02 | 0.4374 | 54.54 | |
| EasyToolBackbone=GTE-Large2026.02 | 0.436 | 54.35 | |
| EasyToolBackbone=BGE-Large2026.02 | 0.4353 | 53.82 | |
| Full-DocBackbone=E5-Large2026.02 | 0.4292 | 51.55 | |
| OnlineRAGBackbone=E5-Large2026.02 | 0.4291 | 53.09 | |
| EasyToolBackbone=Contriever2026.02 | 0.4199 | 52.87 | |
| OnlineRAGBackbone=E5-Base2026.02 | 0.4186 | 50.85 | |
| PLUToBackbone=API Retriever2026.02 | 0.4173 | 51.02 | |
| EasyToolBackbone=E5-Large2026.02 | 0.4168 | 52.53 | |
| Full-DocBackbone=E5-Base2026.02 | 0.4109 | 49.28 | |
| Full-DocBackbone=COLT2026.02 | 0.4063 | 49.66 | |
| OnlineRAGBackbone=BGE-Large2026.02 | 0.4038 | 50.08 | |
| EasyToolBackbone=E5-Base2026.02 | 0.4018 | 50.36 | |
| Full-DocBackbone=BM252026.02 | 0.3947 | 48.58 | |
| EasyToolBackbone=API Retriever2026.02 | 0.3946 | 50.55 | |
| PLUToBackbone=MiniLM-L62026.02 | 0.3895 | 49.31 | |
| Full-DocBackbone=GTE-Large2026.02 | 0.3869 | 49.16 | |
| Full-DocBackbone=API Retriever2026.02 | 0.3861 | 47.56 | |
| Full-DocBackbone=BGE-Large2026.02 | 0.3853 | 47.78 | |
| OnlineRAGBackbone=Contriever2026.02 | 0.3831 | 47.61 | |
| OnlineRAGBackbone=API Retriever2026.02 | 0.3776 | 47.43 | |
| Full-DocBackbone=Contriever2026.02 | 0.3762 | 46.08 | |
| OnlineRAGBackbone=GTE-Large2026.02 | 0.3624 | 46.68 | |
| OnlineRAGBackbone=MiniLM-L62026.02 | 0.3445 | 45.11 | |
| Full-DocBackbone=MiniLM-L62026.02 | 0.3273 | 41.78 | |
| EasyToolBackbone=MiniLM-L62026.02 | 0.3109 | 41.45 |