Tool Redirection on OpenAgent Tier-2
26.5Accuracy DeltaSFT-200 + PAFT
Evaluation results
| Method | Links | |
|---|---|---|
| SFT-200 + PAFTtraining_steps=200, PAFT=true2026.07 | 26.5 | |
| SFT-400 + PAFTtraining_steps=400, PAFT=true2026.07 | 4.9 | |
| SFT-600 + PAFTtraining_steps=600, PAFT=true2026.07 | -2.9 | |
| PAFT (EFP only)training_steps=800, perturbation_ratio=0.3, component=EFP2026.07 | -3.2 | |
| SFT-800 + PAFTtraining_steps=800, PAFT=true2026.07 | -5.3 | |
| PAFT (alpha=0.3 default)training_steps=800, perturbation_ratio=0.32026.07 | -5.3 | |
| PAFT (alpha=0.2)training_steps=800, perturbation_ratio=0.22026.07 | -7.7 | |
| PAFT (alpha=0.4)training_steps=800, perturbation_ratio=0.42026.07 | -7.8 | |
| Base2026.07 | -8.5 | |
| PAFT (SRP only)training_steps=800, perturbation_ratio=0.3, component=SRP2026.07 | -34.2 | |
| PAFT (SBP only)training_steps=800, perturbation_ratio=0.3, component=SBP2026.07 | -36.5 | |
| SFT-800training_steps=8002026.07 | -45.3 | |
| SFT-400training_steps=4002026.07 | -45.4 | |
| SFT-600training_steps=6002026.07 | -46.4 | |
| SFT-200training_steps=2002026.07 | -48.2 |