List your company

Code Generation on HumanEval (SR and Tau)

2.82Success Rate (SR)D-PACE
2.39362.50432.6152.7257May 12, 2026

Evaluation results

MethodLinks
D-PACETarget=Llama-3.1-8B-Instruct, Temperature (T)=0, Drafter=3L, Epoch=62026.052.823.69
D-PACETarget=Qwen3-8B, Temperature (T)=0, Drafter=3L, Epoch=62026.052.753.76
DFlashTarget=Llama-3.1-8B-Instruct, Temperature (T)=0, Drafter=3L, Epoch=62026.052.533.31
DFlashTarget=Qwen3-8B, Temperature (T)=0, Drafter=3L, Epoch=62026.052.413.28