Generative Code Completion on Embedded Systems Code (STM32 HAL) (test)
39.9Generative Token AccuracySpark
Evaluation results
| Method | Links | |
|---|---|---|
| SparkParameters=7B2026.03 | 39.9 | |
| Qwen3-30BParameters=30B2026.03 | 32.8 | |
| Claude Opus 4.6Parameters=>100B2026.03 | 18.1 | |
| Base OLMo2026.03 | 4.3 |