Cross-file code completion on CrossCodeEval C# (test)
75.38Code ESStarCoder2
Evaluation results
| Method | Links | ||
|---|---|---|---|
| StarCoder2Parameters=15B2024.02 | 75.38 | 62.14 | |
| DeepSeekCoderParameters=33B2024.02 | 75.04 | 63.03 | |
| DeepSeekCoderParameters=6.7B2024.02 | 74.84 | 62.29 | |
| CodeLlamaParameters=34B2024.02 | 73.96 | 60.07 | |
| StarCoder2Parameters=7B2024.02 | 72.73 | 57.69 | |
| CodeLlamaParameters=13B2024.02 | 72.73 | 59.62 | |
| StarCoderBaseParameters=7B2024.02 | 71.93 | 55.98 | |
| StarCoderBaseParameters=15B2024.02 | 71.77 | 55.71 | |
| CodeLlamaParameters=7B2024.02 | 71.41 | 56.66 | |
| DeepSeekCoderParameters=1.3B2024.02 | 70.98 | 54.84 | |
| StarCoder2Parameters=3B2024.02 | 70.86 | 55.42 | |
| StarCoderBaseParameters=3B2024.02 | 70.11 | 53.15 | |
| StableCodeParameters=3B2024.02 | 61.7 | 48.98 |