Private CNN Inference on ImageNet
7.9LAN Latency (s)Jaguar
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| JaguarModel=ResNet-18, AVX=AVX-5122026.06 | 7.9 | — | — | — | — | — | |
| JaguarModel=ResNet18, AVX=Disabled2026.06 | 8.64 | 3.51 | 15.94 | 2.32 | 315.02 | 1.16 | |
| JaguarModel=MobileNetV2, AVX=AVX-5122026.06 | 16.83 | — | — | — | — | — | |
| JaguarModel=MobileNetV2, AVX=Disabled2026.06 | 18.41 | 2.55 | 32.42 | 2.07 | 592.5 | 1.76 | |
| JaguarModel=ResNet-50, AVX=AVX-5122026.06 | 25.55 | — | — | — | — | — | |
| RhombusModel=ResNet18, AVX=Disabled2026.06 | 29.04 | 1.04 | 36.24 | 1.02 | 344.01 | 1.07 | |
| CheetahModel=ResNet18, AVX=Disabled2026.06 | 30.3 | 1 | 36.94 | 1 | 366.94 | 1 | |
| JaguarModel=ResNet50, AVX=Disabled2026.06 | 32.44 | 3.72 | 51.5 | 2.77 | 962 | 1.39 | |
| CheetahModel=MobileNetV2, AVX=Disabled2026.06 | 46.99 | 1 | 67.25 | 1 | 1,042.62 | 1 | |
| RhombusModel=MobileNetV2, AVX=Disabled2026.06 | 58.98 | 0.8 | 77.19 | 0.87 | 836.81 | 1.25 | |
| RhombusModel=ResNet50, AVX=Disabled2026.06 | 96.77 | 1.25 | 111.44 | 1.28 | 750.22 | 1.78 | |
| CheetahModel=ResNet50, AVX=Disabled2026.06 | 120.82 | 1 | 142.72 | 1 | 1,335.63 | 1 |