Image Processing Inference on ViT (Vision Transformer)
3.81Average Latency (ms)ET QNN
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ET QNNHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=NPU, dtype=int82026.05 | 3.81 | 3.79 | 3.83 | |
| ET CoreMLHardware=Apple iPhone 15 Pro (A17 Pro), Backend=Auto, dtype=fp162026.05 | 10.55 | 10.49 | 10.65 | |
| CoreMLHardware=Apple iPhone 15 Pro (A17 Pro), Backend=Auto, dtype=fp162026.05 | 10.56 | 10.51 | 10.62 | |
| ET XNNPACKHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=CPU, dtype=int82026.05 | 64.97 | 53.31 | 76.19 | |
| ET XNNPACKHardware=Google Pixel 9 Pro XL (Tensor G4), Backend=CPU, dtype=int82026.05 | 80.45 | 79.75 | 81.17 | |
| ONNXHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=CPU, dtype=int82026.05 | 84.46 | 75.43 | 94.69 | |
| LiteRTHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=NPU, dtype=int82026.05 | 91.02 | 90.77 | 107.07 | |
| ONNXHardware=Google Pixel 9 Pro XL (Tensor G4), Backend=CPU, dtype=int82026.05 | 103.82 | 89.95 | 175.27 | |
| LiteRTHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=CPU, dtype=int82026.05 | 115.91 | 113.77 | 131.01 | |
| ET VulkanHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=GPU, dtype=fp162026.05 | 136.11 | 125.95 | 140.55 | |
| ONNXHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=GPU, dtype=int82026.05 | 137.22 | 129.64 | 142.97 | |
| ONNXHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=GPU, dtype=fp162026.05 | 168.54 | 129.25 | 241.39 | |
| ONNXHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=NPU, dtype=int82026.05 | 175.94 | 173.5 | 178.69 | |
| LiteRTHardware=Samsung Galaxy S25 Ultra (Snapdragon 8 Elite), Backend=GPU, dtype=fp162026.05 | 329.52 | 288.16 | 425.49 | |
| ET VulkanHardware=Google Pixel 9 Pro XL (Tensor G4), Backend=GPU, dtype=fp162026.05 | 392.4 | 381.56 | 406.68 | |
| LiteRTHardware=Google Pixel 9 Pro XL (Tensor G4), Backend=CPU, dtype=int82026.05 | 468.78 | 404.09 | 494.06 |