Tool Retrieval and Function Selection on Taskbench-HF
0.75MRRDynamic LR (DTDR-L)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Dynamic LR (DTDR-L)LLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.75 | 27.8 | 0.63 | |
| Dynamic LR (DTDR-L)2025.12 | 0.75 | — | 0.63 | |
| Dynamic DR (DTDR-C)LLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.64 | 27.5 | 0.55 | |
| Dynamic DR (DTDR-C)2025.12 | 0.64 | — | 0.55 | |
| LRLLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.53 | 20.5 | 0.32 | |
| LR (Erdogan et al. 2024)2025.12 | 0.53 | — | 0.32 | |
| DRLLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.46 | 17.1 | 0.33 | |
| DR (Liu et al. 2024a)2025.12 | 0.46 | — | 0.33 | |
| QTS (Gao et al. 2025)LLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.37 | 14.6 | 0.27 | |
| QTS (Gao et al. 2025)2025.12 | 0.37 | — | 0.27 | |
| QTS (Paramanayakam et al. 2025)LLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.3 | 12.9 | 0.18 | |
| QTS (Paramanayakam et al. 2025)2025.12 | 0.3 | — | 0.18 | |
| QTS (Vanilla)LLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.21 | 7.9 | 0.08 | |
| QTS (Vanilla)2025.12 | 0.21 | — | 0.08 | |
| BM-25LLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.18 | 8.3 | 0.05 | |
| BM-252025.12 | 0.18 | — | 0.05 | |
| Random GuessLLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.16 | 4.2 | 0.05 | |
| Random Guess2025.12 | 0.16 | — | 0.05 |