Code Generation on HumanEval+ (0-shot)
80.86AccuracyERNIE 5.0-Base
Evaluation results
| Method | Links | |
|---|---|---|
| ERNIE 5.0-BaseNumber of shots=0-shot2026.02 | 80.86 | |
| Kimi K2-BaseNumber of shots=0-shot2026.02 | 70.73 | |
| DS V3.2-Exp-BaseNumber of shots=0-shot2026.02 | 53.99 |
| Method | Links | |
|---|---|---|
| ERNIE 5.0-BaseNumber of shots=0-shot2026.02 | 80.86 | |
| Kimi K2-BaseNumber of shots=0-shot2026.02 | 70.73 | |
| DS V3.2-Exp-BaseNumber of shots=0-shot2026.02 | 53.99 |