Tool Retrieval on APIBank
73.2NDCG@10MFTR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MFTRBackbone=E5-Base2026.02 | 73.2 | 76.32 | |
| MFTRBackbone=MiniLM-L62026.02 | 72.37 | 78.63 | |
| MFTRBackbone=E5-Large2026.02 | 72.19 | 74.26 | |
| MFTRBackbone=BGE-Large2026.02 | 71.7 | 74.59 | |
| MFTRBackbone=API Retriever2026.02 | 69.23 | 78.38 | |
| MFTRBackbone=GTE-Large2026.02 | 68.88 | 71.95 | |
| Full-DocBackbone=BGE-Large2026.02 | 68.56 | 75.25 | |
| MFTRBackbone=Contriever2026.02 | 68.16 | 72.03 | |
| MFTRBackbone=BM252026.02 | 67.04 | 69.06 | |
| EasyToolBackbone=GTE-Large2026.02 | 66.29 | 73.43 | |
| MFTRBackbone=COLT2026.02 | 64.56 | 74.01 | |
| Full-DocBackbone=E5-Large2026.02 | 64.12 | 73.93 | |
| EasyToolBackbone=E5-Large2026.02 | 63.73 | 71.95 | |
| Full-DocBackbone=GTE-Large2026.02 | 63.31 | 69.72 | |
| EasyToolBackbone=COLT2026.02 | 62.71 | 73.93 | |
| EasyToolBackbone=BGE-Large2026.02 | 62.49 | 73.93 | |
| Full-DocBackbone=E5-Base2026.02 | 61.9 | 74.42 | |
| EasyToolBackbone=E5-Base2026.02 | 61.48 | 68.73 | |
| Full-DocBackbone=MiniLM-L62026.02 | 61.12 | 74.42 | |
| EasyToolBackbone=MiniLM-L62026.02 | 61.09 | 73.93 | |
| EasyToolBackbone=Contriever2026.02 | 59.6 | 68.15 | |
| Full-DocBackbone=Contriever2026.02 | 58.94 | 68.98 | |
| EasyToolBackbone=BM252026.02 | 56.37 | 65.51 | |
| EasyToolBackbone=API Retriever2026.02 | 56.03 | 69.72 | |
| PLUToBackbone=BGE-Large2026.02 | 55.57 | 61.63 | |
| Full-DocBackbone=COLT2026.02 | 54.41 | 66.25 | |
| PLUToBackbone=E5-Large2026.02 | 53.04 | 59.82 | |
| PLUToBackbone=MiniLM-L62026.02 | 52.18 | 57.67 | |
| Full-DocBackbone=API Retriever2026.02 | 51.71 | 65.51 | |
| Full-DocBackbone=BM252026.02 | 51.67 | 61.39 | |
| PLUToBackbone=COLT2026.02 | 50.55 | 65.02 | |
| PLUToBackbone=GTE-Large2026.02 | 49.71 | 56.44 | |
| PLUToBackbone=E5-Base2026.02 | 49.57 | 58.17 | |
| PLUToBackbone=API Retriever2026.02 | 48.63 | 58.17 | |
| PLUToBackbone=Contriever2026.02 | 48.59 | 53.71 | |
| PLUToBackbone=BM252026.02 | 42.22 | 50.33 | |
| OnlineRAGBackbone=E5-Large2026.02 | 27.32 | 44.14 | |
| OnlineRAGBackbone=GTE-Large2026.02 | 24.06 | 33.5 | |
| OnlineRAGBackbone=BGE-Large2026.02 | 23.5 | 36.14 | |
| OnlineRAGBackbone=API Retriever2026.02 | 23.46 | 32.84 | |
| OnlineRAGBackbone=COLT2026.02 | 22.96 | 33.42 | |
| OnlineRAGBackbone=E5-Base2026.02 | 22.16 | 30.94 | |
| OnlineRAGBackbone=Contriever2026.02 | 21.77 | 33.66 | |
| OnlineRAGBackbone=MiniLM-L62026.02 | 20.16 | 29.62 |