Function Calling on BFCL Non-Live v4
87.06AccuracyDVAO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DVAOBase Model=Qwen2.5-7B-Instruct2026.05 | 87.06 | 95.11 | |
| GDPOBase Model=Qwen2.5-7B-Instruct2026.05 | 86.73 | 85.83 | |
| RCBase Model=Qwen2.5-7B-Instruct2026.05 | 85.33 | 96.11 | |
| DVAOBase Model=Qwen2.5-3B-Instruct2026.05 | 84.75 | 95.11 | |
| ACBase Model=Qwen2.5-3B-Instruct2026.05 | 82.35 | 84.82 | |
| GDPOBase Model=Qwen2.5-3B-Instruct2026.05 | 82.08 | 84.53 | |
| GRPOBase Model=Qwen2.5-7B-Instruct2026.05 | 81.65 | 0 | |
| RCBase Model=Qwen2.5-3B-Instruct2026.05 | 79.94 | 83.45 | |
| Qwen2.5-7B-InstructType=Base Model2026.05 | 69.56 | 0 | |
| ACBase Model=Qwen2.5-7B-Instruct2026.05 | 56.21 | 85.4 | |
| GRPOBase Model=Qwen2.5-3B-Instruct2026.05 | 47.94 | 5.18 | |
| Qwen2.5-3B-InstructType=Base Model2026.05 | 47.1 | 4.89 |