Cross-file code completion on CrossCodeEval Java (test)
74.92Code ESStarCoder2
Evaluation results
| Method | Links | ||
|---|---|---|---|
| StarCoder2Parameters=15B2024.02 | 74.92 | 70.45 | |
| CodeLlamaParameters=34B2024.02 | 74.3 | 69.45 | |
| DeepSeekCoderParameters=33B2024.02 | 73.41 | 69.02 | |
| StableCodeParameters=3B2024.02 | 73.19 | 67.93 | |
| CodeLlamaParameters=13B2024.02 | 73.08 | 68.29 | |
| CodeLlamaParameters=7B2024.02 | 71.49 | 65.99 | |
| StarCoder2Parameters=7B2024.02 | 70.75 | 65.27 | |
| DeepSeekCoderParameters=6.7B2024.02 | 70.6 | 66.28 | |
| StarCoderBaseParameters=15B2024.02 | 70.58 | 64.66 | |
| StarCoderBaseParameters=7B2024.02 | 69.91 | 64.12 | |
| StarCoderBaseParameters=3B2024.02 | 66.43 | 59.77 | |
| StarCoder2Parameters=3B2024.02 | 66.31 | 61.06 | |
| DeepSeekCoderParameters=1.3B2024.02 | 65.92 | 59.93 |