List your company

ResearchFormerly WizWand

Private Inference Efficiency

Benchmarks

DatasetSOTA methodMetricTrendResultsLast updated

In-queue inputs WAN2 Online phase

2.9Latency (s)

48

Mar 16, 2026

In-queue inputs LAN Online phase

9.9Communication Overhead (MiB)

48

Mar 16, 2026

In-queue inputs WAN4 Online phase

2.6Time (s)

32

Mar 16, 2026

In-queue inputs WAN3 Online phase

1.9Inference Time (s)

32

Mar 16, 2026

In-queue inputs WAN1 Online phase

2.4Time (s)

32

Mar 16, 2026

WAN4 Environment

2.6Inference Time (s)

16

Mar 16, 2026

WAN3 Environment

2.1Inference Time (s)

16

Mar 16, 2026

WAN1 Environment

2.4Inference Time (s)

16

Mar 16, 2026