Private Inference
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
6.17Runtime (WAN)
18
Apr 23, 2026
3.04Runtime (min)
18
Feb 26, 2026
2.04Runtime (min)
18
Feb 26, 2026
2.07Runtime (WAN)
12
Apr 23, 2026
7.62Embed Inference Time (s)
7
Feb 26, 2026
5.17Embed Inference Time (s)
7
Feb 26, 2026
16.83LAN Latency (s)
3
Jun 11, 2026
25.55Latency (LAN, s)
3
Jun 11, 2026
7.9LAN Latency (s)
3
Jun 11, 2026
61.72LAN Latency (s)
3
Apr 23, 2026
0.002Latency (LAN)
3
Apr 23, 2026
500,000CMult
1
Feb 26, 2026
—
—Primary metric
0
Apr 23, 2026
—
—Latency (WAN)
0
Feb 26, 2026
—
—Runtime (WAN)
0
Feb 26, 2026