Function Selection on TinyAgent
94.2Function Selection AccuracyDTDR-L
Evaluation Results
| Method | Links | |
|---|---|---|
| DTDR-LBackbone=GPT-4o2025.12 | 94.2 | |
| DTDR-LBackbone=Qwen3 14B2025.12 | 92.5 | |
| DTDR-LBackbone=Qwen3 8B2025.12 | 89 | |
| Raw DemonstrationsBackbone=GPT-4o2025.12 | 86.8 | |
| Dependency RetrievalBackbone=GPT-4o2025.12 | 85.9 | |
| DTDR-CBackbone=GPT-4o2025.12 | 85.9 | |
| DTDR-CBackbone=Qwen3 14B2025.12 | 84.8 | |
| No ICLBackbone=GPT-4o2025.12 | 84.7 | |
| DTDR-LBackbone=Qwen3 4B2025.12 | 80.7 | |
| DTDR-CBackbone=Qwen3 8B2025.12 | 80.4 | |
| Dependency RetrievalBackbone=Qwen3 14B2025.12 | 79.5 | |
| DTDR-LBackbone=Qwen3 1.7B2025.12 | 78.4 | |
| No ICLBackbone=Qwen3 14B2025.12 | 78 | |
| Raw DemonstrationsBackbone=Qwen3 14B2025.12 | 77.9 | |
| Dependency RetrievalBackbone=Qwen3 8B2025.12 | 76.7 | |
| No ICLBackbone=Qwen3 8B2025.12 | 71.3 | |
| DTDR-CBackbone=Qwen3 4B2025.12 | 68.1 | |
| Raw DemonstrationsBackbone=Qwen3 8B2025.12 | 67.8 | |
| Dynamic LR (DTDR-L)LLM Backbone=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 65.1 | |
| DTDR-CBackbone=Qwen3 1.7B2025.12 | 64.1 | |
| Dependency RetrievalBackbone=Qwen3 4B2025.12 | 62.7 | |
| Raw DemonstrationsBackbone=Qwen3 4B2025.12 | 60.2 | |
| No ICLBackbone=Qwen3 4B2025.12 | 59.6 | |
| DTDR-LBackbone=Gorilla V22025.12 | 58.7 | |
| Learned RetrievalBackbone=GPT-4o2025.12 | 53.2 | |
| Learned RetrievalBackbone=Qwen3 4B2025.12 | 52.2 | |
| Dependency RetrievalBackbone=Qwen3 1.7B2025.12 | 51.6 | |
| Learned RetrievalBackbone=Qwen3 14B2025.12 | 51.1 | |
| Learned RetrievalBackbone=Qwen3 1.7B2025.12 | 50.5 | |
| No ICLBackbone=Qwen3 1.7B2025.12 | 48.1 | |
| Raw DemonstrationsBackbone=Qwen3 1.7B2025.12 | 46.3 | |
| DTDR-LBackbone=Qwen3 0.6B2025.12 | 46.1 | |
| Learned RetrievalBackbone=Qwen3 8B2025.12 | 43.7 | |
| DTDR-CBackbone=Gorilla V22025.12 | 43.4 | |
| Dynamic DR (DTDR-C)LLM Backbone=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 43.3 | |
| No ICLBackbone=Gorilla V22025.12 | 39.5 | |
| Learned RetrievalBackbone=Gorilla V22025.12 | 37.9 | |
| DTDR-CBackbone=Qwen3 0.6B2025.12 | 35.3 | |
| Dependency RetrievalBackbone=Gorilla V22025.12 | 32.2 | |
| DR (Liu et al. 2024a)LLM Backbone=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 30.7 | |
| LR (Erdogan et al. 2024)LLM Backbone=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 25.6 | |
| QTS (Paramanayakam et al. 2025)LLM Backbone=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 23.7 | |
| No ICLBackbone=Qwen3 0.6B2025.12 | 23.2 | |
| BM-25LLM Backbone=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 23.1 | |
| Dependency RetrievalBackbone=Qwen3 0.6B2025.12 | 22 | |
| QTS (Gao et al. 2025)LLM Backbone=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 21.5 | |
| Learned RetrievalBackbone=Qwen3 0.6B2025.12 | 19.8 | |
| Raw DemonstrationsBackbone=Qwen3 0.6B2025.12 | 17.2 | |
| QTS (Vanilla)LLM Backbone=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 15.8 | |
| Random GuessLLM Backbone=Qwen 3 0.6B, ICL Method=hard masking2025.12 | 5.9 |