Code Generation on EditBench
53.7Pass@1GPT o4-mini
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT o4-mini2026.03 | 53.7 | 83.33 | |
| SEMREP2026.03 | 53.7 | 88.89 | |
| QwQ-32BMode=Finetuned2026.03 | 50.93 | 75 | |
| QwQ-32BMode=Base2026.03 | 47.22 | 76.85 |
Loading the SOTA2 catalog…
| Method | Links | ||
|---|---|---|---|
| GPT o4-mini2026.03 | 53.7 | 83.33 | |
| SEMREP2026.03 | 53.7 | 88.89 | |
| QwQ-32BMode=Finetuned2026.03 | 50.93 | 75 | |
| QwQ-32BMode=Base2026.03 | 47.22 | 76.85 |