Generative Code Completion on Embedded Systems Code Infineon AURIX (test)
54.3Generative Token AccuracySpark
Evaluation Results
| Method | Links | |
|---|---|---|
| SparkParameters=7B2026.03 | 54.3 | |
| Qwen3-30BParameters=30B2026.03 | 31.3 | |
| Base OLMo2026.03 | 29.9 | |
| Claude Opus 4.6Parameters=>100B2026.03 | 26.5 |