Semantic Segmentation on A2D2 (test)
65mIoUSegFormer-B0
Evaluation results
| Method | Links | ||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SegFormer-B0FPS (1080 Ti)=18, FPS (Orin Nano)=92026.01 | 65 | 85 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EfficientNet-B4FPS (1080 Ti)=25, FPS (Orin Nano)=132026.01 | 60 | 80 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EfficientNet-B4 + TTRMethod Enhancement=Temporal Token Reuse (TTR), FPS (1080 Ti)=42, FPS (Orin Nano)=212026.01 | 59.7 | 79.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BiSeNetV2FPS (1080 Ti)=55, FPS (Orin Nano)=282026.01 | 58 | 80 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ResNet-50FPS (1080 Ti)=24, FPS (Orin Nano)=122026.01 | 54 | 74 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ResNet-50 + TTRMethod Enhancement=Temporal Token Reuse (TTR), FPS (1080 Ti)=38, FPS (Orin Nano)=192026.01 | 53.8 | 73.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MobileNetV3FPS (1080 Ti)=70, FPS (Orin Nano)=352026.01 | 52 | 81 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EPMF2021.06 | 45 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.3 | 0 | 52.1 | 33.3 | 29.4 | 0 | 1.5 | 92.4 | 15.3 | 57.4 | 0 | 55 | 66.3 | 70 | 94.5 | 54.2 | 80.5 | 0 | 0 | |
| PMF2021.06 | 41.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 65.4 | 0 | 46.6 | 22.6 | 26.3 | 0 | 3.7 | 91.7 | 17.8 | 48.6 | 0 | 48.9 | 64.1 | 69.2 | 94.1 | 53.5 | 78.4 | 0 | 0 | |
| Cylinder3D2021.06 | 24.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 57.7 | 0 | 20.5 | 10.6 | 10.4 | 1.5 | 2.5 | 82.9 | 9.1 | 47.4 | 0 | 19.1 | 8 | 33.8 | 89.7 | 13 | 63.5 | 0 | 0 | |
| PolarNetFPS=38.4, Latency=0.031s, MACs=60B, Params=14M2020.03 | 23.9 | 85.4 | 23.8 | 10.1 | 18.2 | 69.7 | 9.6 | 49.1 | 58.5 | 0 | 11.3 | 0 | 28.3 | 37.6 | 24.8 | 42.8 | 0 | 14.8 | 0 | 8 | 11 | 55.6 | 0 | 14.8 | 11.9 | 7 | 0 | 4.4 | 81.6 | 12.8 | 42.5 | 0 | 12.7 | 11.5 | 31.8 | 90.3 | 9.2 | 57 | 0 | 0 | |
| PolarNet2021.06 | 23.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 55.6 | 0 | 14.8 | 11.9 | 7 | 0 | 4.4 | 81.6 | 12.8 | 42.5 | 0 | 12.7 | 11.5 | 31.8 | 90.3 | 9.2 | 57 | 0 | 0 | |
| Uni-modal baseline2021.06 | 21.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 45.7 | 0 | 14 | 2.7 | 9.1 | 0 | 0.1 | 74.6 | 3.1 | 38.1 | 0 | 12.3 | 11.5 | 35.5 | 90.2 | 14.2 | 59 | 0 | 0 | |
| Unet w/ Cartesian BEVFPS=49.5, Latency=0.028s, MACs=60B, Params=14M2020.03 | 20.3 | 83.5 | 27 | 7.3 | 20.3 | 66 | 1.9 | 25.2 | 54.7 | 6.5 | 12.7 | 0 | 20.3 | 26.8 | 21.4 | 42.5 | 0 | 9.5 | 0 | 4.3 | 11 | 44.7 | 0 | 11.8 | 11.9 | 6.4 | 0 | 0 | 81.6 | 11.9 | 35.1 | 0 | 6.9 | 13.7 | 20.2 | 89.2 | 5.8 | 56.1 | 0 | 0 | |
| 2DPASS2021.06 | 18.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 37 | 0 | 13.8 | 6.7 | 5 | 0 | 0.3 | 74.8 | 5.9 | 35.1 | 0 | 8.6 | 10 | 11.9 | 85.6 | 6.9 | 57.5 | 0 | 0 | |
| DarkNet53FPS=16.1, Latency=0.063s, MACs=378B, Params=50M2020.03 | 17.2 | 82 | 15.2 | 0.8 | 6.1 | 68.5 | 0 | 15.5 | 63.8 | 0.4 | 0.3 | 0 | 17.3 | 23.8 | 13.3 | 35.6 | 0 | 6.3 | 0 | 3.9 | 7.6 | 38.7 | 0 | 10.8 | 4.4 | 3.3 | 0 | 0 | 77.9 | 3.1 | 31.5 | 0 | 9.4 | 7.3 | 15.7 | 86.4 | 12.9 | 55.2 | 0 | 0 | |
| DarkNet532021.06 | 17.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 38.7 | 0 | 10.8 | 4.4 | 3.3 | 0 | 0 | 77.9 | 3.1 | 31.5 | 0 | 9.4 | 7.3 | 15.7 | 86.4 | 12.9 | 55.2 | 0 | 0 | |
| Squeezesegv2FPS=67.1, Latency=0.015s, MACs=15B, Params=0.9M2020.03 | 16.4 | 81 | 15.4 | 0.2 | 8.6 | 63.8 | 0 | 16.8 | 61.7 | 0.6 | 0.1 | 0 | 14.8 | 24.7 | 12.7 | 33.2 | 0 | 5.8 | 0 | 0.2 | 5.2 | 29.5 | 0 | 10.3 | 5.5 | 2.7 | 0 | 1.9 | 76.4 | 3.8 | 29.2 | 0 | 6.4 | 12.4 | 17.1 | 85.8 | 12.1 | 50.9 | 0 | 0 | |
| SqueezeSeg V22021.06 | 16.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 29.5 | 0 | 10.3 | 5.5 | 2.7 | 0 | 1.9 | 76.4 | 3.8 | 29.2 | 0 | 6.4 | 12.4 | 17.1 | 85.8 | 12.1 | 50.9 | 0 | 0 | |
| SqueezesegFPS=87.5, Latency=0.009s, MACs=15B, Params=0.9M2020.03 | 8.9 | — | 9.7 | 0 | 0 | 15.8 | 0 | 0.7 | 64.4 | 0 | 0.4 | 0 | 2.2 | 15.6 | 0.5 | 15.9 | 0 | 0 | 0 | 0 | 0.3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 64.5 | 0 | 13.7 | 0 | 0 | 0.1 | 0.2 | 77.7 | 10.4 | 27.7 | 0 | 0 | |
| SqueezeSeg2021.06 | 8.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 64.5 | 0 | 13.7 | 0 | 0 | 0.1 | 0.2 | 77.7 | 10.4 | 27.7 | 0 | 0 |