End-to-end Task Completion on τ-Bench Retail, N=5
0.111Task Completion RateLlama3.1-8B
Evaluation results
| Method | Links | |
|---|---|---|
| Llama3.1-8BSchema configuration=PA-Tool2025.10 | 0.111 | |
| Qwen2.5-7BSchema configuration=PA-Tool2025.10 | 0.097 | |
| Llama3.1-8BSchema configuration=Base2025.10 | 0.097 | |
| Qwen2.5-7BSchema configuration=Base2025.10 | 0.068 | |
| Llama3.2-3BSchema configuration=PA-Tool2025.10 | 0.056 | |
| Llama3.2-3BSchema configuration=Base2025.10 | 0.045 | |
| Qwen2.5-3BSchema configuration=PA-Tool2025.10 | 0.038 | |
| Qwen2.5-3BSchema configuration=Base2025.10 | 0.037 |