Code Generation on HumanEval (Acc., Steps, TPF)
60.37AccuracyKLASS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| KLASSBase Decoder=Dream2026.07 | 60.37 | 75.09 | 3.41 | |
| KLASS + TACGBase Decoder=Dream2026.07 | 60.37 | 72.05 | 3.55 | |
| d3LLM†Base Decoder=Dream2026.07 | 57.1 | — | 3.2 | |
| Conf.Base Decoder=Dream2026.07 | 47.56 | 51.19 | 5 | |
| Conf. + TACGBase Decoder=Dream2026.07 | 47.56 | 49.45 | 5.18 |