Tool Use on Tool-use multi-turn (test)
76.8AccuracyDiverge (ExIt ablation)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Diverge (ExIt ablation)Backbone=Qwen2.5-7B-Instruct, Improvement steps (K)=4, Number of training runs=32025.09 | 76.8 | 0.6 | |
| Full ExItBackbone=Qwen2.5-7B-Instruct, Improvement steps (K)=4, Number of training runs=32025.09 | 76.4 | 1.2 | |
| Improve (ExIt ablation)Backbone=Qwen2.5-7B-Instruct, Improvement steps (K)=4, Number of training runs=32025.09 | 75.5 | 3.4 | |
| GRPO + curriculumBackbone=Qwen2.5-7B-Instruct, Improvement steps (K)=4, Number of training runs=32025.09 | 75.4 | 1 | |
| GRPOBackbone=Qwen2.5-7B-Instruct, Improvement steps (K)=4, Number of training runs=32025.09 | 73.5 | -0.5 | |
| Base modelBackbone=Qwen2.5-7B-Instruct, Improvement steps (K)=4, Number of training runs=32025.09 | 60.5 | 0.1 |