TOOLRET
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ToolRet
45.96Avg nDCG@10
21
ToolRet CN v1.0 (test)
98HR
18
TOOLRET Zero-Shot Macro-Avg
36.9nDCG@10
15
TOOLRET Zero-Shot Custom
45.8nDCG@10
15
TOOLRET Zero-Shot Code
32nDCG@10
15
TOOLRET Zero-Shot Web*
34.9nDCG@10
15
TOOLRET In-Domain (Avg)
63.1nDCG@10
15
ToolRet (Customized)
42.38N@10
11
ToolRet (Code)
45.93N@10
11
ToolRet EN v1.0 (test)
92.6Hit Rate (HR)
9
ToolRet EN
92.6Hit Rate (%)
5
ToolRet 1,839 services (test)
92.6Hit Rate
2