List your company

Large Language Model Inference on Code Assistant

104TPSDReSD
11.4435.4759.583.53Feb 21, 2025

Evaluation results

MethodLinks
DReSDBackbone=CodeLlama-7B, Decoding Strategy=greedy decoding2025.02104
DReSDBackbone=CodeLlama-13B, Decoding Strategy=greedy decoding2025.0285
DReSDBackbone=Llama2-Chat-7B, Decoding Strategy=greedy decoding2025.0278
RESTBackbone=CodeLlama-7B, Decoding Strategy=greedy decoding2025.0272
RESTBackbone=Llama2-Chat-7B, Decoding Strategy=greedy decoding2025.0255
DReSDBackbone=Llama2-Chat-13B, Decoding Strategy=greedy decoding2025.0250
PLDBackbone=CodeLlama-7B, Decoding Strategy=greedy decoding2025.0242
RESTBackbone=CodeLlama-13B, Decoding Strategy=greedy decoding2025.0239
RESTBackbone=Llama2-Chat-13B, Decoding Strategy=greedy decoding2025.0232
SDBackbone=CodeLlama-7B, Decoding Strategy=greedy decoding2025.0231
PLDBackbone=CodeLlama-13B, Decoding Strategy=greedy decoding2025.0229
SDBackbone=Llama2-Chat-7B, Decoding Strategy=greedy decoding2025.0225
SDBackbone=CodeLlama-13B, Decoding Strategy=greedy decoding2025.0221
PLDBackbone=Llama2-Chat-7B, Decoding Strategy=greedy decoding2025.0221
SDBackbone=Llama2-Chat-13B, Decoding Strategy=greedy decoding2025.0220
LLMBackbone=CodeLlama-7B, Decoding Strategy=greedy decoding2025.0219
LLMBackbone=Llama2-Chat-7B, Decoding Strategy=greedy decoding2025.0219
PLDBackbone=Llama2-Chat-13B, Decoding Strategy=greedy decoding2025.0219
LLMBackbone=CodeLlama-13B, Decoding Strategy=greedy decoding2025.0215
LLMBackbone=Llama2-Chat-13B, Decoding Strategy=greedy decoding2025.0215