Instruction Following on MT-Bench (Latency and Tau)
8.32Latency (ms/tok)CADDTREE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CADDTREEBackbone=Qwen3-4B, Temperature=0.02026.06 | 8.32 | 6.44 | 235 | |
| DDTree-oracleBackbone=Qwen3-4B, Temperature=0.02026.06 | 8.34 | 6.47 | 256 | |
| CADDTREEBackbone=Qwen3-8B, Temperature=0.02026.06 | 8.58 | 6.22 | 172 | |
| DDTree-oracleBackbone=Qwen3-8B, Temperature=0.02026.06 | 8.59 | 6.1 | 128 | |
| DFlashBackbone=Qwen3-4B, Temperature=0.02026.06 | 12.59 | 4.39 | — | |
| DFlashBackbone=Qwen3-8B, Temperature=0.02026.06 | 12.71 | 4.28 | — | |
| ARBackbone=Qwen3-8B, Temperature=0.02026.06 | 30.38 | — | — | |
| ARBackbone=Qwen3-4B, Temperature=0.02026.06 | 31.07 | — | — |