List your company
ResearchFormerly WizWand

Neural Network Inference Latency on ARM Embedded Processors

0.071Latency (ms)Deterministic NN
-108.25256622.931471,354.11552,085.29953Nov 28, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Deterministic NNArchitecture=MLP, batch-size=10, Processor=Cortex-A76, Tuning Status=tuned2025.110.071—
Deterministic NNArchitecture=MLP, batch-size=10, Processor=Cortex-A72, Tuning Status=tuned2025.110.186—
Deterministic NNArchitecture=MLP, batch-size=100, Processor=Cortex-A76, Tuning Status=tuned2025.110.23—
PFPArchitecture=MLP, batch-size=10, Processor=Cortex-A76, Tuning Status=tuned2025.110.341901.8
Deterministic NNArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A76, Tuning Status=tuned2025.110.347—
PFPArchitecture=MLP, batch-size=10, Processor=Cortex-A72, Tuning Status=tuned2025.110.742990.2
Deterministic NNArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A72, Tuning Status=tuned2025.110.754—
Deterministic NNArchitecture=MLP, batch-size=10, Processor=Cortex-A53, Tuning Status=tuned2025.110.933—
Deterministic NNArchitecture=MLP, batch-size=100, Processor=Cortex-A72, Tuning Status=tuned2025.111.134—
PFPArchitecture=MLP, batch-size=100, Processor=Cortex-A76, Tuning Status=tuned2025.111.2255.7
Deterministic NNArchitecture=MLP, batch-size=10, Processor=Cortex-A76, Tuning Status=not tuned2025.111.64—
PFPArchitecture=MLP, batch-size=10, Processor=Cortex-A76, Tuning Status=not tuned2025.111.89—
Deterministic NNArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A76, Tuning Status=tuned2025.113.131—
Deterministic NNArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A76, Tuning Status=not tuned2025.113.16—
PFPArchitecture=MLP, batch-size=10, Processor=Cortex-A72, Tuning Status=not tuned2025.113.75—
PFPArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A76, Tuning Status=tuned2025.113.897205.6
Deterministic NNArchitecture=MLP, batch-size=10, Processor=Cortex-A72, Tuning Status=not tuned2025.114.59—
Deterministic NNArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A53, Tuning Status=tuned2025.114.726—
PFPArchitecture=MLP, batch-size=10, Processor=Cortex-A53, Tuning Status=tuned2025.114.989—
PFPArchitecture=MLP, batch-size=100, Processor=Cortex-A72, Tuning Status=tuned2025.115.182149.6
Deterministic NNArchitecture=MLP, batch-size=100, Processor=Cortex-A53, Tuning Status=tuned2025.116.565—
Deterministic NNArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A72, Tuning Status=not tuned2025.116.89—
Deterministic NNArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A72, Tuning Status=tuned2025.119.524—
PFPArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A76, Tuning Status=not tuned2025.119.63—
PFPArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A72, Tuning Status=tuned2025.1110.022119.4
Deterministic NNArchitecture=MLP, batch-size=10, Processor=Cortex-A53, Tuning Status=not tuned2025.1114.02—
PFPArchitecture=MLP, batch-size=10, Processor=Cortex-A53, Tuning Status=not tuned2025.1115.26—
PFPArchitecture=MLP, batch-size=100, Processor=Cortex-A53, Tuning Status=tuned2025.1115.358—
Deterministic NNArchitecture=MLP, batch-size=100, Processor=Cortex-A76, Tuning Status=not tuned2025.1116.3—
PFPArchitecture=MLP, batch-size=100, Processor=Cortex-A76, Tuning Status=not tuned2025.1118.6—
Deterministic NNArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A53, Tuning Status=not tuned2025.1121.14—
PFPArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A72, Tuning Status=not tuned2025.1121.23—
Deterministic NNArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A76, Tuning Status=not tuned2025.1131.51—
PFPArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A53, Tuning Status=tuned2025.1135.159—
PFPArchitecture=MLP, batch-size=100, Processor=Cortex-A72, Tuning Status=not tuned2025.1136.33—
Deterministic NNArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A53, Tuning Status=tuned2025.1141.697—
PFPArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A76, Tuning Status=tuned2025.1145.03955.3
Deterministic NNArchitecture=MLP, batch-size=100, Processor=Cortex-A72, Tuning Status=not tuned2025.1145.81—
Deterministic NNArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A72, Tuning Status=not tuned2025.1170.08—
PFPArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A53, Tuning Status=not tuned2025.1176.09—
PFPArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A72, Tuning Status=tuned2025.11116.3323.3
PFPArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A76, Tuning Status=not tuned2025.11119.76—
Deterministic NNArchitecture=MLP, batch-size=100, Processor=Cortex-A53, Tuning Status=not tuned2025.11137.8—
PFPArchitecture=MLP, batch-size=100, Processor=Cortex-A53, Tuning Status=not tuned2025.11147.61—
Deterministic NNArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A53, Tuning Status=not tuned2025.11209.28—
PFPArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A72, Tuning Status=not tuned2025.11240.94—
SVIArchitecture=MLP, batch-size=100, Processor=Cortex-A762025.11306.89—
SVIArchitecture=MLP, batch-size=10, Processor=Cortex-A762025.11307.52—
PFPArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A53, Tuning Status=tuned2025.11383.68—
SVIArchitecture=MLP, batch-size=10, Processor=Cortex-A722025.11734.74—
SVIArchitecture=MLP, batch-size=100, Processor=Cortex-A722025.11775.32—
PFPArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A53, Tuning Status=not tuned2025.11801.33—
SVIArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A762025.11801.4—
SVIArchitecture=LeNet-5, batch-size=10, Processor=Cortex-A722025.111,196.42—
SVIArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A762025.112,488.73—
SVIArchitecture=LeNet-5, batch-size=100, Processor=Cortex-A722025.112,708.16—