Multi-language Programming on Aider-Polyglot
61.7ScoreGPT-o1
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-o1Backbone=GPT-o12025.09 | 61.7 | |
| CRITIQUE-CODERBackbone=Qwen3-8B, Thinking Mode=true, Training Strategy=CRL2025.09 | 35.6 | |
| Qwen3-8B-RLBackbone=Qwen3-8B, Thinking Mode=true, Training Strategy=Standard RL2025.09 | 34.5 | |
| Baseline (Qwen3-8B)Backbone=Qwen3-8B, Thinking Mode=true, Training Strategy=Baseline2025.09 | 28.4 | |
| CRITIQUE-CODERBackbone=Qwen3-4B, Thinking Mode=true, Training Strategy=CRL2025.09 | 24.4 | |
| Qwen3-4B-RLBackbone=Qwen3-4B, Thinking Mode=true, Training Strategy=Standard RL2025.09 | 23.6 | |
| Baseline (Qwen3-4B)Backbone=Qwen3-4B, Thinking Mode=true, Training Strategy=Baseline2025.09 | 21.8 | |
| DeepSeek-R1-Distill-14BBackbone=DeepSeek-R1-Distill-14B2025.09 | 18.6 | |
| DeepCoder-14BBackbone=DeepCoder-14B2025.09 | 18.4 | |
| DeepSeek-V2.5-238BBackbone=DeepSeek-V2.5-238B2025.09 | 17.8 |