List your company
ResearchFormerly WizWand

LLM Request Scheduling on LongBench (test)

52.5263Average LatencyOracle SVF
45.57746492.482107139.38675186.291393Jun 21, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Oracle SVFModel=Llama-3.1-8B-Instruct, Arrival Scenario=Burst-arrival2026.0652.5263128.7662—
SVFModel=Llama-3.1-8B-Instruct, Arrival Scenario=Burst-arrival2026.0670.0169215.175628.2
1-bit SVFModel=Llama-3.1-8B-Instruct, Arrival Scenario=Burst-arrival2026.0672.5786249.23528.7
Oracle SJFModel=Llama-3.1-8B-Instruct, Arrival Scenario=Burst-arrival2026.0674.301134.4113—
SJFModel=Llama-3.1-8B-Instruct, Arrival Scenario=Burst-arrival2026.06106.1588300.254225.9
Oracle SVFModel=Llama-3.1-70B-Instruct, Arrival Scenario=Burst-arrival2026.06108.4169251.4195—
FCFSModel=Llama-3.1-8B-Instruct, Arrival Scenario=Burst-arrival2026.06125.8883393.141323.9
SVFModel=Llama-3.1-70B-Instruct, Arrival Scenario=Burst-arrival2026.06140.4193420.240412.5
1-bit SVFModel=Llama-3.1-70B-Instruct, Arrival Scenario=Burst-arrival2026.06141.4835524.774912.4
Oracle SJFModel=Llama-3.1-70B-Instruct, Arrival Scenario=Burst-arrival2026.06144.3262242.7121—
SJFModel=Llama-3.1-70B-Instruct, Arrival Scenario=Burst-arrival2026.06173.9461442.17211.9
FCFSModel=Llama-3.1-70B-Instruct, Arrival Scenario=Burst-arrival2026.06226.2472721.382310.9