End-to-End Inference
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
74.46p99 TTFT (ms)
18
Feb 26, 2026
318Inference Latency (s)
12
Jun 4, 2026
124.74Total Score
2
Jun 2, 2026
137.92Total Score
2
Jun 2, 2026
144.66Total Score
2
Jun 2, 2026
39.79Total Inference Time
2
Jun 2, 2026
8.35Inference Time (s)
2
Apr 15, 2026