Code Repair on CodeFix
85.5Fix Success RateGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oInteraction Mode=M42026.01 | 85.5 | |
| o3-miniInteraction Mode=M42026.01 | 80.6 | |
| GPT-4oInteraction Mode=M22026.01 | 80 | |
| GPT-4oInteraction Mode=M32026.01 | 79.7 | |
| o3-miniInteraction Mode=M32026.01 | 74.5 | |
| o3-miniInteraction Mode=M22026.01 | 61.7 | |
| o3-miniInteraction Mode=M12026.01 | 35.6 | |
| GPT-4oInteraction Mode=M12026.01 | 29.5 | |
| Qwen2.5-7BInteraction Mode=M22026.01 | 28.4 | |
| Qwen2.5-7BInteraction Mode=M42026.01 | 28.1 | |
| Qwen2.5-7BInteraction Mode=M32026.01 | 27.2 | |
| Qwen2.5-Coder-7BInteraction Mode=M32026.01 | 26.3 | |
| Qwen2.5-Coder-7BInteraction Mode=M22026.01 | 22.2 | |
| DeepSeek-R1-Distill-Qwen-7BInteraction Mode=M22026.01 | 16.3 | |
| DeepSeek-R1-Distill-Qwen-7BInteraction Mode=M32026.01 | 16.3 | |
| Qwen2.5-7BInteraction Mode=M12026.01 | 14.5 | |
| DeepSeek-R1-Distill-Qwen-7BInteraction Mode=M42026.01 | 14.2 | |
| Qwen2.5-Coder-7BInteraction Mode=M42026.01 | 13.6 | |
| Qwen2.5-Coder-7BInteraction Mode=M12026.01 | 11.8 | |
| DeepSeek-R1-Distill-Qwen-7BInteraction Mode=M12026.01 | 8.3 |