Software Engineering on SWE-rebench 4B
31.49Avg@8 BC%EvoTrainer
Evaluation results
| Method | Links | |
|---|---|---|
| EvoTrainerConfiguration=Proposed Method2026.06 | 31.49 | |
| Human-engineered RLConfiguration=Reference2026.06 | 31.17 | |
| RAGEN v2 SNR FilteringConfiguration=Algorithmic Baseline2026.06 | 30.03 | |
| RAGEN v1 FilteringConfiguration=Algorithmic Baseline2026.06 | 29.87 | |
| Group-Variance FilteringConfiguration=Algorithmic Baseline2026.06 | 29.06 | |
| AutoResearchConfiguration=Reference2026.06 | 28.41 | |
| GRPO + Clip-HigherConfiguration=Algorithmic Baseline2026.06 | 25.49 | |
| GSPO + Clip-HigherConfiguration=Algorithmic Baseline2026.06 | 24.84 | |
| Base model (no RL)RL=None2026.06 | 24.68 |