Function Calling on BFCL Live v4
79.68AccuracyDVAO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DVAOBase Model=Qwen2.5-7B-Instruct2026.05 | 79.68 | 77.93 | |
| GDPOBase Model=Qwen2.5-7B-Instruct2026.05 | 76.17 | 68.9 | |
| RCBase Model=Qwen2.5-7B-Instruct2026.05 | 75.06 | 87.58 | |
| DVAOBase Model=Qwen2.5-3B-Instruct2026.05 | 72.73 | 77.44 | |
| ACBase Model=Qwen2.5-3B-Instruct2026.05 | 69.43 | 67.04 | |
| GRPOBase Model=Qwen2.5-7B-Instruct2026.05 | 68.76 | 0 | |
| GDPOBase Model=Qwen2.5-3B-Instruct2026.05 | 67.73 | 65.08 | |
| RCBase Model=Qwen2.5-3B-Instruct2026.05 | 67.51 | 61.71 | |
| ACBase Model=Qwen2.5-7B-Instruct2026.05 | 63.8 | 67.39 | |
| Qwen2.5-7B-InstructType=Base Model2026.05 | 62.92 | 0 | |
| GRPOBase Model=Qwen2.5-3B-Instruct2026.05 | 59.73 | 10.35 | |
| Qwen2.5-3B-InstructType=Base Model2026.05 | 59.44 | 11.02 |