Tool Calling on In-domain seen
74.05EMTInR-U
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TInR-U2026.04 | 74.05 | 84.86 | 77.3 | |
| ToolGen2026.04 | 71.89 | 83.78 | 77.3 | |
| TR-Feedback+ToolRLRetriever=TR-Feedback, Reasoning Model=ToolRL2026.04 | 62.7 | 73.51 | 71.35 | |
| ToolRetriever+ToolRLRetriever=ToolRetriever, Reasoning Model=ToolRL2026.04 | 61.08 | 75.14 | 70.27 | |
| ATU2026.04 | 61.08 | 74.59 | 71.35 | |
| Ada-embedding+ToolRLRetriever=Ada-embedding, Reasoning Model=ToolRL2026.04 | 58.38 | 69.19 | 67.57 | |
| ToolRetriever+Qwen3-8BRetriever=ToolRetriever, Reasoning Model=Qwen3-8B2026.04 | 58.38 | 71.89 | 64.32 | |
| BM25+ToolRLRetriever=BM25, Reasoning Model=ToolRL2026.04 | 54.59 | 65.41 | 61.62 | |
| ToolRetriever+xLAM-7b-rRetriever=ToolRetriever, Reasoning Model=xLAM-7b-r2026.04 | 48.65 | 60 | 54.05 | |
| ToolRetriever+Hammer2.1-7bRetriever=ToolRetriever, Reasoning Model=Hammer2.1-7b2026.04 | 36.22 | 44.32 | 41.08 |