List your company

LLM Serving on Evol-CodeAlpaca

234.09p90 Latency (ms/token)Oracle SJF
209.0256378.2103547.395716.5797Sep 25, 2025

Evaluation results

MethodLinks
Oracle SJFModel=Llama, Workload Mode=Burst Mode2025.09234.09
Oracle SJFModel=DeepSeek-R1, Workload Mode=Burst Mode2025.09269.06
PARSModel=Llama, Workload Mode=Burst Mode2025.09279.26
Cross-Model PARSModel=Llama, Workload Mode=Burst Mode2025.09290.88
Pointwise SJFModel=Llama, Workload Mode=Burst Mode2025.09292.19
Listwise SJFModel=Llama, Workload Mode=Burst Mode2025.09310.87
PARSModel=DeepSeek-R1, Workload Mode=Burst Mode2025.09327.73
Listwise SJFModel=DeepSeek-R1, Workload Mode=Burst Mode2025.09412.53
Cross-Model PARSModel=DeepSeek-R1, Workload Mode=Burst Mode2025.09435.29
Pointwise SJFModel=DeepSeek-R1, Workload Mode=Burst Mode2025.09446.98
FCFSModel=Llama, Workload Mode=Burst Mode2025.09699.22
FCFSModel=DeepSeek-R1, Workload Mode=Burst Mode2025.09860.7