Latency Prediction on NNLQ in-domain v1 (test)
1.11MAPE (Average)NN-Former
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| NN-FormerTest Domain=NasBench2012025.07 | 1.11 | 0.96 | 100 | 100 | |
| NNLPTest Domain=NasBench2012025.07 | 1.46 | 1.31 | 100 | 100 | |
| NN-FormerTest Domain=MnasNet2025.07 | 1.52 | 1.48 | 99.5 | 100 | |
| NN-FormerTest Domain=MobileNetV22025.07 | 1.54 | 1.5 | 99.6 | 100 | |
| NAR-Former V2Test Domain=MnasNet2025.07 | 1.8 | 1.7 | 99.7 | 100 | |
| NAR-Former V2Test Domain=NasBench2012025.07 | 1.82 | 1.18 | 100 | 100 | |
| NAR-Former V2Test Domain=MobileNetV22025.07 | 1.83 | 1.72 | 99.9 | 100 | |
| NN-FormerTest Domain=EfficientNet2025.07 | 2.31 | 2.21 | 99 | 100 | |
| NAR-Former V2Test Domain=EfficientNet2025.07 | 2.34 | 2.22 | 98.5 | 100 | |
| NNLPTest Domain=MobileNetV22025.07 | 2.47 | 2.37 | 99.3 | 99.5 | |
| NNLPTest Domain=MnasNet2025.07 | 2.6 | 2.46 | 97.7 | 98.5 | |
| NN-FormerTest Domain=ResNet2025.07 | 2.66 | 2.47 | 99.45 | 99.5 | |
| NN-FormerTest Domain=Average2025.07 | 2.85 | 2.65 | 97.45 | 97.85 | |
| NN-FormerTest Domain=VGG2025.07 | 2.94 | 2.89 | 95.8 | 96.5 | |
| NNLPTest Domain=EfficientNet2025.07 | 3.04 | 2.82 | 98 | 97 | |
| NAR-Former V2Test Domain=Average2025.07 | 3.07 | 3 | 96.41 | 96.3 | |
| NN-FormerTest Domain=SqueezeNet2025.07 | 3.09 | 3.08 | 97.7 | 98 | |
| NAR-Former V2Test Domain=ResNet2025.07 | 3.11 | 2.89 | 98.55 | 99 | |
| NAR-Former V2Test Domain=MobileNetV32025.07 | 3.12 | 2.98 | 96.75 | 98 | |
| NN-FormerTest Domain=MobileNetV32025.07 | 3.17 | 2.99 | 96.5 | 97 | |
| NNLPTest Domain=ResNet2025.07 | 3.34 | 3.25 | 98.4 | 98.5 | |
| NNLPTest Domain=Average2025.07 | 3.47 | 3.44 | 95.25 | 95.5 | |
| NN-FormerTest Domain=GoogleNet2025.07 | 3.48 | 3.39 | 97.15 | 97.5 | |
| NNLPTest Domain=MobileNetV32025.07 | 3.5 | 3.43 | 95.35 | 96 | |
| NAR-Former V2Test Domain=VGG2025.07 | 3.51 | 3.29 | 95.85 | 96 | |
| NAR-Former V2Test Domain=SqueezeNet2025.07 | 3.54 | 3.34 | 95.95 | 96.5 | |
| NAR-Former V2Test Domain=GoogleNet2025.07 | 3.63 | 3.46 | 95.95 | 95.5 | |
| NNLPTest Domain=VGG2025.07 | 3.73 | 3.63 | 95.25 | 96.5 | |
| NNLPTest Domain=SqueezeNet2025.07 | 4.03 | 3.97 | 93.25 | 93 | |
| NNLPTest Domain=GoogleNet2025.07 | 4.18 | 4.12 | 93.7 | 93.5 | |
| NN-FormerTest Domain=AlexNet2025.07 | 4.69 | 4.61 | 90.5 | 91 | |
| NAR-Former V2Test Domain=AlexNet2025.07 | 6.18 | 5.97 | 81.9 | 84 | |
| NNLPTest Domain=AlexNet2025.07 | 6.37 | 6.21 | 81.75 | 84.5 |