Text Generation on MBPP
5.64Latency (ms/tok)DDTree-oracle
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DDTree-oracleBackbone=Qwen3-4B, Temperature=1.02026.06 | 5.64 | 8.43 | 256 | — | — | |
| CADDTREEBackbone=Qwen3-4B, Temperature=1.02026.06 | 5.8 | 8.32 | — | 260 | — | |
| CADDTREEBackbone=Qwen3-8B, Temperature=1.02026.06 | 6.18 | 7.89 | — | 187 | — | |
| DDTree-oracleBackbone=Qwen3-8B, Temperature=1.02026.06 | 6.27 | 7.62 | 128 | — | — | |
| DFlashBackbone=Qwen3-4B, Temperature=1.02026.06 | 8.08 | 5.66 | — | — | — | |
| DFlashBackbone=Qwen3-8B, Temperature=1.02026.06 | 8.95 | 5.21 | — | — | — | |
| ARBackbone=Qwen3-4B, Temperature=1.02026.06 | 30.79 | — | — | — | — | |
| ARBackbone=Qwen3-8B, Temperature=1.02026.06 | 31.6 | — | — | — | — |