Fatal Error on OpenAgent Tier-4
0RR (Fatal Error Rate)SFT-400
Evaluation Results
| Method | Links | |
|---|---|---|
| SFT-400training_steps=4002026.07 | 0 | |
| SFT-600training_steps=6002026.07 | 0.1 | |
| SFT-800training_steps=8002026.07 | 0.2 | |
| SFT-200training_steps=2002026.07 | 0.3 | |
| PAFT (EFP only)training_steps=800, perturbation_ratio=0.3, component=EFP2026.07 | 1.7 | |
| PAFT (SRP only)training_steps=800, perturbation_ratio=0.3, component=SRP2026.07 | 2.1 | |
| Base2026.07 | 12.2 | |
| PAFT (alpha=0.2)training_steps=800, perturbation_ratio=0.22026.07 | 90.4 | |
| PAFT (alpha=0.4)training_steps=800, perturbation_ratio=0.42026.07 | 96.4 | |
| SFT-400 + PAFTtraining_steps=400, PAFT=true2026.07 | 97.8 | |
| PAFT (SBP only)training_steps=800, perturbation_ratio=0.3, component=SBP2026.07 | 99.2 | |
| SFT-200 + PAFTtraining_steps=200, PAFT=true2026.07 | 99.3 | |
| SFT-600 + PAFTtraining_steps=600, PAFT=true2026.07 | 99.6 | |
| SFT-800 + PAFTtraining_steps=800, PAFT=true2026.07 | 99.6 | |
| PAFT (alpha=0.3 default)training_steps=800, perturbation_ratio=0.32026.07 | 99.6 |