API Execution Simulation on StableToolBench
16.47ID High Success RateQWEN-2.5-3B-SWIRL
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| QWEN-2.5-3B-SWIRLBackbone=Qwen-2.5, Size=3B, Mode=SWIRL2026.02 | 16.47 | 16.9 | 21.2 | 15.57 | 2.92 | 14.61 | |
| QWEN-2.5-3B-SFTBackbone=Qwen-2.5, Size=3B, Mode=SFT2026.02 | 16.03 | 12.87 | 17.51 | 14.86 | 2.99 | 12.85 | |
| OLMO-3-7B-INSTRUCTBackbone=OLMo-3, Size=7B, Mode=Instruct2026.02 | 8.28 | 13.33 | 7.62 | 9.15 | 7.54 | 9.18 | |
| QWEN-2.5-3B-INSTRUCTBackbone=Qwen-2.5, Size=3B, Mode=Instruct2026.02 | 7.74 | 7.74 | 9.48 | 6.59 | 3.18 | 6.95 | |
| QWEN-2.5-32B-INSTRUCTBackbone=Qwen-2.5, Size=32B, Mode=Instruct2026.02 | 7.13 | 7.13 | 10.22 | 7.75 | 4.34 | 7.31 | |
| QWEN-2.5-14B-INSTRUCTBackbone=Qwen-2.5, Size=14B, Mode=Instruct2026.02 | 6.23 | 8.68 | 8.58 | 6.48 | 3.27 | 6.65 | |
| QWEN-2.5-7B-INSTRUCTBackbone=Qwen-2.5, Size=7B, Mode=Instruct2026.02 | 5.93 | 9.89 | 8.3 | 9.17 | 3.2 | 7.3 | |
| DEEPSEEK-7B-CHATBackbone=DeepSeek, Size=7B, Mode=Chat2026.02 | 5.38 | 15.17 | 4.44 | 8.52 | 4.17 | 7.54 |