List your company
ResearchFormerly WizWand

Code Generation on CodeAlpaca

5.67Average Speed-upDReSD
0.8862.1283.374.612Feb 21, 2025Apr 18, 2025Jun 14, 2025Aug 10, 2025Oct 5, 2025Dec 1, 2025Jan 27, 2026
Updated 8mo ago

Evaluation results

MethodLinks
DReSDBackbone=CodeLlama-13B, Retrieval Type=Static dense retrieval2025.025.67
DReSDBackbone=CodeLlama-7B, Retrieval Type=Static dense retrieval2025.025.47
DReSDBackbone=Average (All Models)2025.024.64
DReSDBackbone=Llama2-Chat-7B, Retrieval Type=Static dense retrieval2025.024.11
RESTBackbone=CodeLlama-7B, Retrieval Type=Static sparse retrieval2025.023.79
DARTModel=Qwen4B, Temperature=02026.013.45
DARTModel=Qwen14B, Temperature=02026.013.44
DARTModel=Qwen8B, Temperature=02026.013.4
DReSDBackbone=Llama2-Chat-13B, Retrieval Type=Static dense retrieval2025.023.33
DARTModel=Qwen14B, Temperature=12026.013.1
DARTModel=L2 7B, Temperature=02026.013.03
DARTModel=Qwen1.7B, Temperature=02026.012.9
RESTBackbone=Llama2-Chat-7B, Retrieval Type=Static sparse retrieval2025.022.89
HydraModel=L2 7B, Temperature=02026.012.89
DARTModel=Qwen32B, Temperature=02026.012.88
RESTBackbone=Average (All Models)2025.022.85
DARTModel=Qwen32B, Temperature=12026.012.78
RESTBackbone=CodeLlama-13B, Retrieval Type=Static sparse retrieval2025.022.6
EAGLE3Model=Qwen32B, Temperature=02026.012.38
EAGLE3Model=Qwen8B, Temperature=02026.012.34
EAGLE3Model=Qwen32B, Temperature=12026.012.3
MedusaModel=L2 7B, Temperature=02026.012.24
PLDBackbone=CodeLlama-7B, Retrieval Type=Dynamic sparse retrieval2025.022.21
EAGLE3Model=Qwen4B, Temperature=02026.012.21
RESTBackbone=Llama2-Chat-13B, Retrieval Type=Static sparse retrieval2025.022.13
EAGLE3Model=Qwen14B, Temperature=02026.012.08
EAGLE3Model=Qwen14B, Temperature=12026.012.01
PLDBackbone=CodeLlama-13B, Retrieval Type=Dynamic sparse retrieval2025.021.93
EAGLE3Model=Qwen1.7B, Temperature=02026.011.93
PLDModel=L2 7B, Temperature=02026.011.75
SDBackbone=CodeLlama-7B, Draft Model=Llama-Chat-68M2025.021.63
PLDBackbone=Average (All Models)2025.021.63
LookaheadModel=L2 7B, Temperature=02026.011.54
SDBackbone=Average (All Models)2025.021.42
SDBackbone=CodeLlama-13B, Draft Model=Llama-Chat-68M2025.021.4
SDBackbone=Llama2-Chat-13B, Draft Model=Llama-Chat-68M2025.021.33
SDBackbone=Llama2-Chat-7B, Draft Model=Llama-Chat-68M2025.021.32
PLDBackbone=Llama2-Chat-13B, Retrieval Type=Dynamic sparse retrieval2025.021.27
PLDBackbone=Llama2-Chat-7B, Retrieval Type=Dynamic sparse retrieval2025.021.11
SPSModel=Qwen32B, Temperature=02026.011.08
SPSModel=Qwen14B, Temperature=02026.011.07