Code Generation on CodeContest
29.1Pass@1CodeSim
Evaluation results
| Method | Links | |
|---|---|---|
| CodeSimLLM=GPT42025.02 | 29.1 | |
| MapCoderLLM=GPT-42024.05 | 28.5 | |
| MapCoderLLM=GPT42025.02 | 28.5 | |
| CodeSimLLM=ChatGPT2025.02 | 16.4 | |
| MapCoderLLM=ChatGPT2024.05 | 12.7 | |
| MapCoderLLM=ChatGPT2025.02 | 12.7 | |
| DirectLLM=GPT-42024.05 | 12.1 | |
| DirectLLM=GPT42025.02 | 12.1 | |
| Self-PlanningLLM=GPT-42024.05 | 10.9 | |
| AnalogicalLLM=GPT-42024.05 | 10.9 | |
| Self-PlanningLLM=GPT42025.02 | 10.9 | |
| AnalogicalLLM=GPT42025.02 | 10.9 | |
| AnalogicalLLM=ChatGPT2024.05 | 7.3 | |
| AnalogicalLLM=ChatGPT2025.02 | 7.3 | |
| CoTLLM=ChatGPT2024.05 | 6.1 | |
| Self-PlanningLLM=ChatGPT2024.05 | 6.1 | |
| CoTLLM=ChatGPT2025.02 | 6.1 | |
| Self-PlanningLLM=ChatGPT2025.02 | 6.1 | |
| DirectLLM=ChatGPT2024.05 | 5.5 | |
| CoTLLM=GPT-42024.05 | 5.5 | |
| DirectLLM=ChatGPT2025.02 | 5.5 | |
| CoTLLM=GPT42025.02 | 5.5 |