Repository Understanding on SWE-bench Verified (test)
6.34StepsRPG-Encoder
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RPG-EncoderBackbone=GPT-52026.02 | 6.34 | 0.22 | 4.15 | |
| LocAgentBackbone=GPT-52026.02 | 6.48 | 0.49 | 1.64 | |
| RPG-EncoderBackbone=GPT-4.12026.02 | 6.75 | 0.18 | 4.63 | |
| LocAgentBackbone=GPT-4.12026.02 | 11.94 | 0.86 | 0.76 | |
| CoSILBackbone=GPT-52026.02 | 19.52 | 0.31 | 2.64 | |
| CoSILBackbone=GPT-4.12026.02 | 19.77 | 0.24 | 3.1 | |
| OrcaLocaBackbone=GPT-4.12026.02 | 20.22 | 0.46 | 1.48 | |
| OrcaLocaBackbone=GPT-52026.02 | 36.93 | 0.75 | 1.16 |