Generative Code Completion on Embedded Systems Code Crypto (test)
13.3Generative Token AccuracyQwen3-30B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-30BParameters=30B2026.03 | 13.3 | |
| Claude Opus 4.6Parameters=>100B2026.03 | 12.8 | |
| Base OLMo2026.03 | 9.4 | |
| SparkParameters=7B2026.03 | 8.2 |