Tool Retrieval on Gorilla
0.3849NDCG@10MFTR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MFTRBackbone=GTE-Large2026.02 | 0.3849 | 59.8 | |
| MFTRBackbone=Contriever2026.02 | 0.3823 | 60 | |
| MFTRBackbone=BGE-Large2026.02 | 0.3796 | 58.8 | |
| MFTRBackbone=MiniLM-L62026.02 | 0.3775 | 58.6 | |
| MFTRBackbone=COLT2026.02 | 0.3764 | 56.6 | |
| MFTRBackbone=BM252026.02 | 0.3716 | 56.2 | |
| EasyToolBackbone=GTE-Large2026.02 | 0.3598 | 55.2 | |
| MFTRBackbone=E5-Base2026.02 | 0.3575 | 55.2 | |
| MFTRBackbone=E5-Large2026.02 | 0.3551 | 55.4 | |
| MFTRBackbone=API Retriever2026.02 | 0.333 | 52.4 | |
| OnlineRAGBackbone=GTE-Large2026.02 | 0.3294 | 48.4 | |
| Full-DocBackbone=GTE-Large2026.02 | 0.3236 | 50.4 | |
| EasyToolBackbone=E5-Large2026.02 | 0.3131 | 49.4 | |
| OnlineRAGBackbone=E5-Large2026.02 | 0.3073 | 45.4 | |
| EasyToolBackbone=BGE-Large2026.02 | 0.3035 | 45.6 | |
| OnlineRAGBackbone=E5-Base2026.02 | 0.2965 | 44.4 | |
| OnlineRAGBackbone=BGE-Large2026.02 | 0.2878 | 43.6 | |
| EasyToolBackbone=E5-Base2026.02 | 0.2867 | 43 | |
| Full-DocBackbone=E5-Large2026.02 | 0.2729 | 39.8 | |
| EasyToolBackbone=Contriever2026.02 | 0.272 | 42 | |
| EasyToolBackbone=BM252026.02 | 0.2697 | 42.2 | |
| Full-DocBackbone=E5-Base2026.02 | 0.2667 | 41.4 | |
| OnlineRAGBackbone=MiniLM-L62026.02 | 0.2582 | 39.6 | |
| OnlineRAGBackbone=Contriever2026.02 | 0.2516 | 38.4 | |
| EasyToolBackbone=COLT2026.02 | 0.2393 | 37.4 | |
| Full-DocBackbone=BM252026.02 | 0.2379 | 35.2 | |
| Full-DocBackbone=Contriever2026.02 | 0.2374 | 37.6 | |
| EasyToolBackbone=MiniLM-L62026.02 | 0.2336 | 37.8 | |
| Full-DocBackbone=COLT2026.02 | 0.216 | 35 | |
| OnlineRAGBackbone=COLT2026.02 | 0.2122 | 32.4 | |
| Full-DocBackbone=BGE-Large2026.02 | 0.2074 | 32.2 | |
| PLUToBackbone=GTE-Large2026.02 | 0.1995 | 31.6 | |
| EasyToolBackbone=API Retriever2026.02 | 0.1988 | 31.4 | |
| PLUToBackbone=Contriever2026.02 | 0.1878 | 29.6 | |
| PLUToBackbone=BM252026.02 | 0.1852 | 31.8 | |
| PLUToBackbone=MiniLM-L62026.02 | 0.1843 | 29 | |
| Full-DocBackbone=MiniLM-L62026.02 | 0.1808 | 31 | |
| OnlineRAGBackbone=API Retriever2026.02 | 0.1789 | 29 | |
| PLUToBackbone=E5-Base2026.02 | 0.1665 | 27.2 | |
| PLUToBackbone=E5-Large2026.02 | 0.1655 | 27 | |
| Full-DocBackbone=API Retriever2026.02 | 0.1607 | 27.4 | |
| PLUToBackbone=BGE-Large2026.02 | 0.1521 | 23.4 | |
| PLUToBackbone=COLT2026.02 | 0.127 | 21.8 | |
| PLUToBackbone=API Retriever2026.02 | 0.1024 | 17 |