Image Processing Inference Latency on ResNet50
0.55Average Latency (ms)ET QNN
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ET QNNHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=NPU, dtype=int82026.05 | 0.55 | 0.5 | 0.6 | |
| ET CoreMLHardware=Apple iPhone 15 Pro (A17 Pro), Backend=Auto, dtype=fp162026.05 | 1.6 | 1.57 | 1.63 | |
| CoreMLHardware=Apple iPhone 15 Pro (A17 Pro), Backend=Auto, dtype=fp162026.05 | 1.68 | 1.58 | 2.06 | |
| ET XNNPACKHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=CPU, dtype=int82026.05 | 4.95 | 4.54 | 5.38 | |
| ET VulkanHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=GPU, dtype=int82026.05 | 5.44 | 4.87 | 5.65 | |
| ONNXHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=GPU, dtype=fp162026.05 | 6.47 | 6.01 | 7.09 | |
| LiteRTHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=NPU, dtype=int82026.05 | 8.96 | 8.76 | 9.58 | |
| LiteRTHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=CPU, dtype=int82026.05 | 8.99 | 8.86 | 9.27 | |
| ET XNNPACKHardware=Google Pixel 9 Pro XL (Tensor G4), Backend=CPU, dtype=int82026.05 | 11.01 | 10.45 | 11.31 | |
| ET VulkanHardware=Google Pixel 9 Pro XL (Tensor G4), Backend=GPU, dtype=int82026.05 | 13.89 | 13.69 | 14.4 | |
| LiteRTHardware=Google Pixel 9 Pro XL (Tensor G4), Backend=CPU, dtype=int82026.05 | 15.35 | 13.62 | 38.98 | |
| ONNXHardware=Google Pixel 9 Pro XL (Tensor G4), Backend=CPU, dtype=int82026.05 | 15.44 | 15.21 | 15.59 | |
| ONNXHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=CPU, dtype=int82026.05 | 16.14 | 16 | 16.26 | |
| ET VulkanHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=GPU, dtype=fp162026.05 | 22.23 | 22.03 | 23.75 | |
| ET VulkanHardware=Google Pixel 9 Pro XL (Tensor G4), Backend=GPU, dtype=fp162026.05 | 64.44 | 64.15 | 64.66 |