List your company
ResearchFormerly WizWand

Chat on Alpaca (SR, τ)

1.79Success Rate (SR)D-PACE
0.6980.98151.2651.5485May 12, 2026
Updated 5mo ago

Evaluation results

MethodLinks
D-PACEDepth=3L, Temperature=0, Model=Qwen3-4B2026.051.792.54
D-PACEDepth=5L, Temperature=0, Model=Qwen3-4B2026.051.732.61
D-PACEDepth=3L, Temperature=1, Model=Qwen3-4B2026.051.732.45
DFlashDepth=3L, Temperature=0, Model=Qwen3-4B2026.051.722.41
D-PACEDepth=5L, Temperature=1, Model=Qwen3-4B2026.051.712.56
DFlashDepth=5L, Temperature=0, Model=Qwen3-4B2026.051.682.49
DFlashDepth=3L, Temperature=1, Model=Qwen3-4B2026.051.672.32
Top-3 prefix maskDepth=3L, Temperature=0, Model=Qwen3-4B2026.051.622.29
DFlashDepth=5L, Temperature=1, Model=Qwen3-4B2026.051.622.39
Top-3 prefix maskDepth=3L, Temperature=1, Model=Qwen3-4B2026.051.62.25
Top-3 prefix maskDepth=5L, Temperature=0, Model=Qwen3-4B2026.051.582.34
Top-3 prefix maskDepth=5L, Temperature=1, Model=Qwen3-4B2026.051.512.23
Accept-rateDepth=3L, Temperature=1, Model=Qwen3-4B2026.050.81.04
Accept-rateDepth=3L, Temperature=0, Model=Qwen3-4B2026.050.791.04
Accept-rateDepth=5L, Temperature=0, Model=Qwen3-4B2026.050.741.01
Accept-rateDepth=5L, Temperature=1, Model=Qwen3-4B2026.050.741.01