Tool Use on APT-Bench
Evaluation results
| Method | Links | |
|---|
| Qwen3Parameters=4B, Variant=Base2025.12 | | 65.8 |
|---|
| Youtu-LLMParameters=2B, Variant=Base2025.12 | | 64.2 |
|---|
| Llama3.1Parameters=8B, Variant=Base2025.12 | | 64.1 |
|---|
| Gemma3Parameters=4B, Variant=Base2025.12 | | 61.7 |
|---|
| SmolLM3Parameters=3B, Variant=Base2025.12 | | 59.1 |
|---|
| Qwen3Parameters=1.7B, Variant=Base2025.12 | | 56.7 |
|---|