Tool Retrieval and Function Selection on TinyAgent
0.651Function Selection AccuracyDynamic LR (DTDR-L)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Dynamic LR (DTDR-L)LLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.651 | 0.93 | 0.55 | |
| Dynamic DR (DTDR-C)LLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.433 | 0.78 | 0.56 | |
| DRLLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.307 | 0.7 | 0.49 | |
| LRLLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.256 | 0.53 | 0.39 | |
| QTS (Paramanayakam et al. 2025)LLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.237 | 0.36 | 0.19 | |
| BM-25LLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.231 | 0.35 | 0.2 | |
| QTS (Gao et al. 2025)LLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.215 | 0.18 | 0.09 | |
| QTS (Vanilla)LLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.158 | 0.26 | 0.14 | |
| Random GuessLLM=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 0.059 | 0.26 | 0.12 |