Cross-file code completion on CrossCodeEval Python (test)
78.78Code ESDeepSeekCoder
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DeepSeekCoderParameters=33B2024.02 | 78.78 | 74.51 | |
| StarCoder2Parameters=15B2024.02 | 78.72 | 74.27 | |
| DeepSeekCoderParameters=6.7B2024.02 | 77.43 | 73.16 | |
| CodeLlamaParameters=34B2024.02 | 76.34 | 71.36 | |
| StableCodeParameters=3B2024.02 | 76 | 70.75 | |
| CodeLlamaParameters=13B2024.02 | 75.88 | 70.97 | |
| CodeLlamaParameters=7B2024.02 | 74.52 | 69.11 | |
| StarCoder2Parameters=7B2024.02 | 74.52 | 68.81 | |
| StarCoderBaseParameters=15B2024.02 | 73.43 | 66.74 | |
| StarCoder2Parameters=3B2024.02 | 73.01 | 67.85 | |
| DeepSeekCoderParameters=1.3B2024.02 | 72.41 | 66.76 | |
| StarCoderBaseParameters=7B2024.02 | 72.24 | 65.4 | |
| StarCoderBaseParameters=3B2024.02 | 69.47 | 62.56 |