List your company
ResearchFormerly WizWand

Long-context language generation on GovReport

3.36Speedup (×)Hybrid Verified Decoding
0.57281.29642.022.7436Feb 24, 2025May 11, 2025Jul 27, 2025Oct 12, 2025Dec 28, 2025Mar 15, 2026May 31, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=SuffixDecoding2026.053.36——
LongSpecBackbone=LC-13B, Temperature=02025.022.673.5876.26
LongSpecBackbone=V-13B, Temperature=02025.022.493.3171.08
LongSpecBackbone=LC-7B, Temperature=02025.022.413.59101.43
LongSpecBackbone=V-7B, Temperature=02025.022.233.57102.23
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=SuffixDecoding2026.052.08——
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=Greedy Decoding2026.052.03——
PLDBackbone=LC-7B, Temperature=02025.021.632.168.66
PLDBackbone=V-7B, Temperature=02025.021.622.273.91
LongSpecBackbone=L-8B, Temperature=02025.021.593.2584.57
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=Greedy Decoding2026.051.52——
PLDBackbone=L-8B, Temperature=02025.021.462.0877.45
MagicDecBackbone=V-13B, Temperature=02025.021.342.9538.24
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=EAGLE32026.051.31——
PLDBackbone=LC-13B, Temperature=02025.021.241.6735.35
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=Frequency-Based Hybrid Decoding2026.051.18——
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=Frequency-Based Hybrid Decoding2026.051.15——
PLDBackbone=V-13B, Temperature=02025.021.131.3732.1
MagicDecBackbone=LC-13B, Temperature=02025.021.12.431.37
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=Frequency-Based Hybrid Decoding2026.051.02——
Hybrid Verified DecodingTarget Model=Qwen3-4B, Reference Baseline=EAGLE32026.051.01——
Vanilla FABackbone=V-7B, Temperature=02025.021145.76
Vanilla FABackbone=V-13B, Temperature=02025.021128.52
Vanilla FABackbone=LC-7B, Temperature=02025.021142.14
Vanilla FABackbone=LC-13B, Temperature=02025.021128.56
Vanilla FABackbone=L-8B, Temperature=02025.021153.14
MagicDecBackbone=LC-7B, Temperature=02025.020.992.2641.9
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=SuffixDecoding2026.050.98——
Hybrid Verified DecodingTarget Model=Qwen3-8B, Reference Baseline=EAGLE32026.050.95——
Hybrid Verified DecodingTarget Model=Llama3.1-8B, Reference Baseline=Greedy Decoding2026.050.95——
MagicDecBackbone=V-7B, Temperature=02025.020.912.2341.68
MagicDecBackbone=L-8B, Temperature=02025.020.682.0436.14
Vanilla HFBackbone=V-7B, Temperature=02025.02—125.25
Vanilla HFBackbone=V-13B, Temperature=02025.02—117.25
Vanilla HFBackbone=LC-7B, Temperature=02025.02—125.27
Vanilla HFBackbone=LC-13B, Temperature=02025.02—117.72
Vanilla HFBackbone=L-8B, Temperature=02025.02—121.59