Patch Adaptation on BackportBench npm and PyPI 1.0 (pooled)
99.6Pass@1 RateVERIPORT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| VERIPORTSetting=with MSP, Model=Claude Opus 4.7 [45]2026.06 | 99.6 | 98.4 | 271 | |
| Claude CodeSetting=with MSP, Model=Claude Opus 4.7 [45]2026.06 | 97.4 | 95.3 | 174 | |
| mini-swe-agentSetting=with MSP, Model=Claude Opus 4.7 [45]2026.06 | 97.3 | 89.8 | 60 | |
| PortGPTSetting=with MSP, Model=Claude Opus 4.7 [45]2026.06 | 89 | 80.5 | 71 | |
| MagentLessSetting=with MSP, Model=Claude Opus 4.7 [45]2026.06 | 63.6 | 50.8 | 18 | |
| git applySetting=with MSP2026.06 | 40.6 | — | 0.02 |