Multi-step LLM Interaction on Qwen3-8B (test)
100High-Precision RatioBF16
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BF16Precision=BF162026.02 | 100 | 89.6 | 6.8 | |
| Random@80%Sampling Ratio=80%2026.02 | 80 | 87.7 | 6.13 | |
| Random@60%Sampling Ratio=60%2026.02 | 60 | 84.83 | 3.38 | |
| Random@40%Sampling Ratio=40%2026.02 | 40 | 86.2 | 8.5 | |
| Router(Ours)Routing=Dynamic Mix Precision2026.02 | 26.7 | 88.8 | 19.85 | |
| Random@20%Sampling Ratio=20%2026.02 | 20 | 83.2 | 2 | |
| GPTQ-3BitQuantization=3-bit2026.02 | 0 | 82.8 | — |