Code Generation on MBPP (retention percentage, accuracy)
123.1Retention (%)Llada-Instruct
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Llada-InstructLayers Skipped=22026.03 | 123.1 | — | |
| Llada-InstructLayers Skipped=32026.03 | 115.4 | — | |
| Llada-InstructLayers Skipped=42026.03 | 115.4 | — | |
| Llada-InstructLayers Skipped=52026.03 | 111.5 | — | |
| Llada-InstructLayers Skipped=02026.03 | 100 | 52 | |
| Dream-BaseLayers Skipped=02026.03 | 100 | 43 | |
| Dream-InstructLayers Skipped=02026.03 | 100 | 71 | |
| Qwen2.5Layers Skipped=02026.03 | 100 | 81 | |
| Llada-InstructLayers Skipped=62026.03 | 94.2 | — | |
| Qwen2.5Layers Skipped=22026.03 | 75.3 | — | |
| Dream-BaseLayers Skipped=32026.03 | 74.4 | — | |
| Llada-InstructLayers Skipped=82026.03 | 71.1 | — | |
| Dream-InstructLayers Skipped=22026.03 | 70.3 | — | |
| Dream-BaseLayers Skipped=22026.03 | 60.5 | — | |
| Qwen2.5Layers Skipped=32026.03 | 55.6 | — | |
| Dream-InstructLayers Skipped=32026.03 | 54.1 | — | |
| Dream-BaseLayers Skipped=42026.03 | 53.5 | — | |
| Dream-InstructLayers Skipped=42026.03 | 37.8 | — | |
| Qwen2.5Layers Skipped=42026.03 | 35.8 | — |