Code Generation on MBPP (Acc., Steps, TPF)
62.65AccuracyKLASS + TACG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| KLASS + TACGBase Decoder=Dream2026.07 | 62.65 | 82.17 | 3.12 | |
| KLASSBase Decoder=Dream2026.07 | 61.87 | 111.25 | 2.3 | |
| Conf. + TACGBase Decoder=Dream2026.07 | 57.59 | 70.93 | 3.61 | |
| Conf.Base Decoder=Dream2026.07 | 57.2 | 73.73 | 3.47 | |
| d3LLM†Base Decoder=Dream2026.07 | 55.6 | — | 2.96 |