List your company
ResearchFormerly WizWand

LLM Serving on Alpaca (Average Latency)

111.46Average Latency (ms/token)Oracle SJF
77.4172307.2061536.995766.7839Sep 25, 2025
Updated 4mo ago

Evaluation results

MethodLinks
Oracle SJFModel=Llama2025.09111.46
PARSModel=Llama2025.09124.92
Oracle SJFModel=DeepSeek-R12025.09137.32
Cross-Model PARSModel=Llama2025.09138.53
PARSModel=DeepSeek-R12025.09148.97
Pointwise SJFModel=Llama2025.09152.3
Listwise SJFModel=Llama2025.09157.07
Cross-Model PARSModel=DeepSeek-R12025.09178.07
Listwise SJFModel=DeepSeek-R12025.09187.41
Pointwise SJFModel=DeepSeek-R12025.09283.39
FCFSModel=DeepSeek-R12025.09372.03
FCFSModel=Llama2025.09962.53