Multi-turn Code Generation on MT-Bench Coding
9First Turn ScoreGPT-4
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-42024.02 | 9 | 8.1 | 8.6 | |
| OpenCodeInterpreterBackbone=DeepSeekCoder-33B2024.02 | 6.8 | 6.7 | 6.8 | |
| OpenCodeInterpreterBackbone=DeepSeekCoder-6.7B2024.02 | 6.7 | 5.8 | 6.3 | |
| DeepSeekCoder-33B-Instruct2024.02 | 6.7 | 4.2 | 5.5 | |
| GPT-3.5-Turbo2024.02 | 6.6 | 7.2 | 6.9 | |
| Claude-Instant-V12024.02 | 6.5 | 7 | 6.8 | |
| OpenCodeInterpreterBackbone=CodeLlama-70B2024.02 | 5.7 | 3.7 | 4.7 | |
| DeepSeekCoder-6.7B-Instruct2024.02 | 5.6 | 4.5 | 5.1 | |
| OpenCodeInterpreterBackbone=CodeLlama-34B2024.02 | 5.6 | 4.1 | 4.9 | |
| OpenCodeInterpreterBackbone=CodeLlama-13B2024.02 | 5.5 | 3.7 | 4.6 | |
| CodeLlama-34B-Instruct2024.02 | 4.5 | 3.4 | 4 | |
| Vicuna-33B-V1.32024.02 | 3.8 | 2.9 | 3.4 | |
| Vicuna-13B-V1.32024.02 | 3.8 | 2.7 | 3.3 | |
| CodeLlama-7B-Instruct2024.02 | 3.3 | 2.5 | 2.9 | |
| CodeLlama-13B-Instruct2024.02 | 3.3 | 2.3 | 2.8 |