Tool Identification on In-domain unseen
75.86EMTInR-U
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TInR-U2026.04 | 75.86 | 81.86 | |
| ToolGen2026.04 | 73.79 | 80.55 | |
| ToolRetriever+Hammer2.1-7bRetriever=ToolRetriever, Reasoning Model=Hammer2.1-7b2026.04 | 59.66 | 68.47 | |
| ToolRetriever+xLAM-7b-rRetriever=ToolRetriever, Reasoning Model=xLAM-7b-r2026.04 | 59.66 | 68.47 | |
| ToolRetriever+Qwen3-8BRetriever=ToolRetriever, Reasoning Model=Qwen3-8B2026.04 | 59.66 | 68.47 | |
| ToolRetriever+ToolRLRetriever=ToolRetriever, Reasoning Model=ToolRL2026.04 | 59.66 | 68.47 | |
| TR-Feedback+ToolRLRetriever=TR-Feedback, Reasoning Model=ToolRL2026.04 | 59.31 | 67.8 | |
| Ada-embedding+ToolRLRetriever=Ada-embedding, Reasoning Model=ToolRL2026.04 | 51.38 | 60.19 | |
| BM25+ToolRLRetriever=BM25, Reasoning Model=ToolRL2026.04 | 42.76 | 51.24 |