Inference Latency
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
6.2Latency (ms)
79
Feb 26, 2026
25.4Latency (ms)
48
Jun 9, 2026
2.81Latency (s)
25
Feb 26, 2026
3.2Inference Latency (s)
18
Jun 30, 2026
4.4Latency (ms)
16
Jul 7, 2026
81Latency (ms)
15
Jun 24, 2026
144Inference Latency (ms)
15
Jun 24, 2026
181Latency (ms)
15
Jun 24, 2026
6.6Latency (ms)
15
Jun 24, 2026
22.9Latency (ms)
15
Jun 24, 2026
16.3Inference Latency (ms)
15
Jun 24, 2026
11.5Latency (ms)
15
Jun 24, 2026
0.009Original Latency (s)
12
May 15, 2026
4Latency (ms)
10
Feb 26, 2026
1.56Latency (ms)
9
Feb 26, 2026
0.203Original Inference Time (s)
8
May 15, 2026
1.167Latency (s)
8
Feb 27, 2026
0.05Latency (ms)
7
Jun 23, 2026
0.12Inference Latency (ms)
7
Mar 4, 2026
40.54Attention Layer Latency (s)
6
Apr 14, 2026
15.7Latency (ms)
5
Feb 26, 2026
0.225Latency (ms)
5
Feb 26, 2026
12.3Mean Latency
4
Feb 26, 2026
0.572Wall Time (s)
3
Apr 23, 2026
1,450Latency (ms)
3
Mar 9, 2026