List your company
ResearchFormerly WizWand

Large Language Model Inference on FinanceQA

1,779ThroughputSpecBundle
121.968552.159982.351,412.541Mar 19, 2026
Updated 7mo ago

Evaluation results

MethodLinks
SpecBundleTarget Model=Qwen-30B-A3B, Draft Model=SpecBundle, #GPUs=42026.031,7791.35
Standard InferenceTarget Model=Qwen-30B-A3B, Draft Model=-, #GPUs=42026.031,320.11
SpecBundleTarget Model=Llama-4-Scout, Draft Model=SpecBundle, #GPUs=82026.031,189.64.12
SpecBundleTarget Model=Llama-3.3-70B, Draft Model=SpecBundle, #GPUs=42026.031,022.72
EAGLE3Target Model=Llama-4-Scout, Draft Model=Existing, #GPUs=82026.031,022.73.54
EAGLE3Target Model=Llama-3.3-70B, Draft Model=Existing, #GPUs=42026.03981.71.92
SpecBundleTarget Model=Qwen-235B-A22B, Draft Model=SpecBundle, #GPUs=82026.038891.65
SpecBundleTarget Model=Ling-Flash-V2, Draft Model=SpecBundle, #GPUs=82026.03863.91.16
Standard InferenceTarget Model=Ling-Flash-V2, Draft Model=-, #GPUs=82026.03747.71
EAGLE3Target Model=Qwen-235B-A22B, Draft Model=Existing, #GPUs=82026.03689.41.28
SpecBundleTarget Model=Kimi-K2, Draft Model=SpecBundle, #GPUs=82026.036601.52
Standard InferenceTarget Model=Qwen-235B-A22B, Draft Model=-, #GPUs=82026.03539.51
Standard InferenceTarget Model=Llama-3.3-70B, Draft Model=-, #GPUs=42026.03512.61
Standard InferenceTarget Model=Kimi-K2, Draft Model=-, #GPUs=82026.03433.41
Standard InferenceTarget Model=Llama-4-Scout, Draft Model=-, #GPUs=82026.03288.91
SpecBundleTarget Model=Llama-3.1-8B, Draft Model=SpecBundle, #GPUs=12026.03258.61.39
EAGLE3Target Model=Llama-3.1-8B, Draft Model=Existing, #GPUs=12026.03237.21.27
Standard InferenceTarget Model=Llama-3.1-8B, Draft Model=-, #GPUs=12026.03185.71