Efficiency Evaluation
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
2,153.43TPS
15
Feb 26, 2026
14.85Avg TTFT
12
Feb 26, 2026
62.4Training Time
11
Feb 26, 2026
13Mean Inference Time (s)
10
May 26, 2026
13.75End-to-End Latency (s)
9
Feb 27, 2026
0.34Inference Time (s)
7
Mar 16, 2026
3.2Average Time per Sample (s)
5
May 13, 2026
4.5Average Time per Sample (s)
5
May 13, 2026
3.79Inference Time (h)
5
Feb 26, 2026
160.32Latency (s)
4
May 11, 2026
3.63Inference Time (s)
4
Apr 7, 2026
1Inference Speed (x)
1
Feb 26, 2026