Generative Code Completion on Embedded Systems Code Wireless/BLE/WiFi (test)
15.3Generative Token AccuracyClaude Opus 4.6
Evaluation results
| Method | Links | |
|---|---|---|
| Claude Opus 4.6Parameters=>100B2026.03 | 15.3 | |
| SparkParameters=7B2026.03 | 7.5 | |
| Qwen3-30BParameters=30B2026.03 | 6.8 | |
| Base OLMo2026.03 | 4.7 |