Object Instance Segmentation on ARMBench Mixed-Object Tote (test)
86.37mAP50RISE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| RISE% Labeled=100%, Backbone=ViT2024.07 | 86.37 | 77.51 | 76.04 | |
| RISE% Labeled=10%, Backbone=ViT2024.07 | 85.16 | 76.26 | 74.95 | |
| RISE% Labeled=1%, Backbone=ViT2024.07 | 84.89 | 74.89 | 73.72 | |
| RISE% Labeled=100%, Backbone=ResNet-1012024.07 | 84.74 | 75.93 | 74.47 | |
| RISE% Labeled=10%, Backbone=ResNet-1012024.07 | 84.33 | 75.54 | 74.27 | |
| RISE% Labeled=2%, Backbone=ViT2024.07 | 84 | 76.25 | 73.92 | |
| RISE% Labeled=100%, Backbone=ResNet-502024.07 | 83.53 | 75.15 | 73.41 | |
| RISE% Labeled=10%, Backbone=ResNet-502024.07 | 83.48 | 75.09 | 73.39 | |
| RISE% Labeled=2%, Backbone=ResNet-1012024.07 | 83.44 | 75.89 | 73.66 | |
| RISE% Labeled=0.5%, Backbone=ViT2024.07 | 83.25 | 73.73 | 72.14 | |
| RISE% Labeled=1%, Backbone=ResNet-1012024.07 | 83.25 | 73.94 | 73 | |
| RoboLLM2023.10 | 83 | 67 | — | |
| RISE% Labeled=2%, Backbone=ResNet-502024.07 | 82.9 | 74.4 | 72.8 | |
| SAM% Labeled=10%, Backbone=ViT2024.07 | 82.78 | 73.96 | 71.47 | |
| SAM% Labeled=1%, Backbone=ViT2024.07 | 82.26 | 70.93 | 67.42 | |
| RISE% Labeled=0.5%, Backbone=ResNet-1012024.07 | 82.1 | 72.3 | 71.4 | |
| RISE% Labeled=1%, Backbone=ResNet-502024.07 | 82.1 | 73.8 | 69.1 | |
| RoboLLM% Labeled=100%, Backbone=ViT2024.07 | 82 | 67 | — | |
| M2F% Labeled=100%, Backbone=ViT2024.07 | 81.2 | 74 | — | |
| RISE% Labeled=0.5%, Backbone=ResNet-502024.07 | 78.8 | 69.67 | 66.15 | |
| DeDETR% Labeled=100%, Backbone=ViT2024.07 | 77.03 | 63.4 | 62.75 | |
| M2F% Labeled=10%, Backbone=ViT2024.07 | 76.5 | 68.2 | 68.2 | |
| DeDETR% Labeled=10%, Backbone=ViT2024.07 | 75.5 | 60.42 | 59.19 | |
| SAM% Labeled=0.5%, Backbone=ViT2024.07 | 74.04 | 63.51 | 61.38 | |
| ResNet50 + Mask RCNNBackbone=ResNet50, Architecture=Mask RCNN2023.10 | 72 | 61 | — | |
| ARMBench% Labeled=100%, Backbone=ResNet-502024.07 | 72 | 61 | — | |
| M2F% Labeled=2%, Backbone=ViT2024.07 | 68.5 | 61.2 | 61.4 | |
| YOLACT% Labeled=10%, Backbone=ResNet-1012024.07 | 68.2 | 52.7 | 47.4 | |
| DeDETR% Labeled=2%, Backbone=ViT2024.07 | 66.2 | 43.39 | 42.15 | |
| M2F% Labeled=1%, Backbone=ViT2024.07 | 64.7 | 58.6 | 58.6 | |
| DeDETR% Labeled=100%, Backbone=ResNet-1012024.07 | 62 | 52.8 | 53.8 | |
| DeDETR% Labeled=100%, Backbone=ResNet-502024.07 | 60.38 | 52.52 | 52.11 | |
| DeDETR% Labeled=10%, Backbone=ResNet-1012024.07 | 59.98 | 49.8 | 52.23 | |
| M2F% Labeled=0.5%, Backbone=ViT2024.07 | 59.9 | 54.7 | 55.3 | |
| YOLACT% Labeled=1%, Backbone=ResNet-1012024.07 | 59.2 | 44.8 | 36.1 | |
| DeDETR% Labeled=10%, Backbone=ResNet-502024.07 | 57.44 | 48.17 | 48 | |
| DeDETR% Labeled=2%, Backbone=ResNet-1012024.07 | 39.7 | 34.19 | 33.14 | |
| DeDETR% Labeled=1%, Backbone=ViT2024.07 | 39.44 | 33.51 | 39.46 | |
| DeDETR% Labeled=2%, Backbone=ResNet-502024.07 | 36.5 | 31.81 | 31.79 | |
| DeDETR% Labeled=0.5%, Backbone=ViT2024.07 | 36.46 | 31.75 | 36.47 | |
| DeDETR% Labeled=1%, Backbone=ResNet-1012024.07 | 34.52 | 29.73 | 30.38 | |
| DeDETR% Labeled=0.5%, Backbone=ResNet-1012024.07 | 30.69 | 28.14 | 28.36 | |
| DeDETR% Labeled=1%, Backbone=ResNet-502024.07 | 29.64 | 26.67 | 27.17 | |
| DeDETR% Labeled=0.5%, Backbone=ResNet-502024.07 | 29.32 | 26.65 | 27.03 |