Tool Use on BFCL (Single Turn/Multi Turn)
86.02Single Turn Success RateEnvFactory
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EnvFactoryBackbone=Qwen3-8B, Env. (Data Scale)=85, Tasks (Data Scale)=2,5752026.05 | 86.02 | 49 | |
| AWMBackbone=Qwen3-4B, Env. (Data Scale)=526, Tasks (Data Scale)=3,3152026.05 | 85.97 | 40.75 | |
| EnvFactoryBackbone=Qwen3-4B, Env. (Data Scale)=85, Tasks (Data Scale)=2,5752026.05 | 85.46 | 48.5 | |
| BaseBackbone=Qwen3-4B, Env. (Data Scale)=–, Tasks (Data Scale)=–2026.05 | 85.15 | 33.5 | |
| EnvFactory (SFT)Backbone=Qwen3-4B, Env. (Data Scale)=85, Tasks (Data Scale)=1,6222026.05 | 85.1 | 44.25 | |
| EnvFactory (SFT)Backbone=Qwen3-8B, Env. (Data Scale)=85, Tasks (Data Scale)=1,6222026.05 | 84.83 | 46.5 | |
| AWMBackbone=Qwen3-8B, Env. (Data Scale)=526, Tasks (Data Scale)=3,3152026.05 | 84.8 | 42.25 | |
| EnvScalerBackbone=Qwen3-8B, Env. (Data Scale)=191, Tasks (Data Scale)=11,5722026.05 | 84.74 | 51.88 | |
| BaseBackbone=Qwen3-8B, Env. (Data Scale)=–, Tasks (Data Scale)=–2026.05 | 84.31 | 41.25 | |
| EnvScalerBackbone=Qwen3-4B, Env. (Data Scale)=191, Tasks (Data Scale)=11,5722026.05 | 83.64 | 45 | |
| BaseBackbone=Qwen3-1.7B, Env. (Data Scale)=–, Tasks (Data Scale)=–2026.05 | 79.48 | 16.75 | |
| EnvFactoryBackbone=Qwen3-1.7B, Env. (Data Scale)=85, Tasks (Data Scale)=2,5752026.05 | 78.44 | 28.38 | |
| EnvFactory (SFT)Backbone=Qwen3-1.7B, Env. (Data Scale)=85, Tasks (Data Scale)=1,6222026.05 | 78.3 | 23.25 | |
| EnvScalerBackbone=Qwen3-1.7B, Env. (Data Scale)=191, Tasks (Data Scale)=11,5722026.05 | 60.41 | 30.13 |