List your company

Code Generation on HumanEval (Throughput, Accuracy)

1.91ThroughputHiSpec
1.29641.45571.6151.7743Oct 1, 2025

Evaluation results

MethodLinks
HiSpecBase Model=Llama3-8B, Accuracy Judge=Llama3.1-70B, Draft Model=None (single model)2025.101.91100
SPRINTERBase Model=Llama3-8B, Accuracy Judge=Llama3.1-70B, Draft Model=Llama3.2-1B2025.101.3242