Code Generation on MultiPL-E v1 (test)
59.1AccuracyQwen2-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2-7BInstruction-tuned=true2024.07 | 59.1 | |
| Llama-3-8BInstruction-tuned=true2024.07 | 48.5 | |
| Qwen1.5-7BInstruction-tuned=true2024.07 | 27.2 |
Loading the SOTA2 catalog…