SemanticKITTI
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SemanticKITTI v1 & v2 (val)
0.149Chamfer Distance (m)
7
SemanticKITTI
87.6AUROC
7
SemanticKITTI (Sequence 07)
99.82SA Score
7
SemanticKITTI
95.8Car IoU
7
SemanticKITTI (val)
46.4Latency (ms)
7
SemanticKITTI
0.156Abs Rel
7
SemanticKITTI (val)
62.2mIoU (10%)
7
SemanticKITTI 5%-labeled (val)
59.5mIoU
7
SemanticKITTI (64 ch.) to nuScenes (32 ch.) (test)
39.2mIoU
7
SemanticKITTI 1.0 (test)
56.89LSTQ
7
SemanticKITTI (val)
39.4mIoU
6
SemanticKITTI in-domain
35.25Precision
6
SemanticKITTI (test)
-34.1D1 Distortion
6
SemanticKITTI OccNL, sequence 08, 90% noise (val)
35.03IoU
6
SemanticKITTI OccNL sequence 08 70% noise (val)
35.86IoU (Overall)
6
SemanticKITTI OccNL sequence 08 50% noise (val)
36.26IoU
6
SemanticKITTI (scenes 6-10)
6.25FPS
6
SemanticKITTI 1.0 (val)
47.28IoU (%)
6
SemanticKITTI (hidden test)
45.1SC IoU
6
SemanticKITTI Multiple Scans
49.7mIoU
6
SemanticKITTI (Sequence 08)
185Total time (s)
6
T2SemanticKITTI
22.14FSVD
5
SemanticKITTI GT v2 (50 held-out frames)
2.83CD (m^2)
5
SemanticKITTI (Split 4)
14.9Novel Class Score
5
SemanticKITTI (Split 3)
20.9Novel Class Score
5