Surgical Instrument Segmentation on EndoVis 2017 (test)
78.57mIoUReMeDI-SAM3
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ReMeDI-SAM3Category=SAM-based, Setting=Training-free2025.12 | 78.57 | 78.57 | 75.65 | 69.07 | 68.51 | 85.78 | 78.68 | 55.06 | 82.52 | 89.9 | — | — | — | — | |
| SP-SAMCategory=SAM-based2025.12 | 73.94 | 73.94 | 71.06 | 68.89 | 53.16 | 83.8 | 73.2 | 72.4 | 84.91 | 61.05 | — | — | — | — | |
| S3NetCategory=Specialist2025.12 | 71.99 | 72.54 | 46.55 | 75.08 | 54.32 | 61.84 | 35.5 | 27.47 | 43.23 | 28.38 | — | — | — | — | |
| SAM3Category=SAM-based, Zero-Shot=true2025.12 | 71.32 | 71.32 | 68.79 | 55.62 | 65.3 | 76.33 | 80.51 | 38.36 | 75.32 | 90.09 | — | — | — | — | |
| SurgicalSAMCategory=SAM-based2025.12 | 69.94 | 69.94 | 67.03 | 68.3 | 51.77 | 75.52 | 68.24 | 57.63 | 86.95 | 60.8 | — | — | — | — | |
| TrackAnythingCategory=SAM-based2025.12 | 64.5 | 67.41 | 62.97 | 55.42 | 44.46 | 62.43 | 83.68 | 62.59 | 67.03 | 65.17 | — | — | — | — | |
| TP-SISCategory=Specialist2025.12 | 63.37 | 63.37 | 52.74 | 66.42 | 45.46 | 75.2 | 73.44 | 29.95 | 44.02 | 34.67 | — | — | — | — | |
| MATIS FrameCategory=Specialist2025.12 | 62.74 | 68.79 | 37.3 | 66.18 | 50.99 | 52.23 | 32.84 | 15.71 | 19.27 | 23.9 | — | — | — | — | |
| MA-SAM2evaluation=zero-shot2025.07 | 62.49 | 62.49 | 59.89 | 54.41 | 50.41 | 64.73 | 73.72 | 32.66 | 72.64 | 70.85 | — | — | — | — | |
| MA-SAM2Category=SAM-based, Zero-Shot=true2025.12 | 62.49 | 62.49 | 59.89 | 54.41 | 50.41 | 64.73 | 73.72 | 32.66 | 72.64 | 70.85 | — | — | — | — | |
| SAM2evaluation=zero-shot2025.07 | 56.39 | 56.39 | 55.38 | 40.7 | 50.92 | 67.77 | 48.38 | 33.4 | 70.66 | 67.14 | — | — | — | — | |
| Surgical SAM2evaluation=zero-shot2025.07 | 54.55 | 54.55 | 54.55 | 42.21 | 46.58 | 59.18 | 50.07 | 37.39 | 88.6 | 57.04 | — | — | — | — | |
| DMNetParam. (M)=4.38, FLOPS (G)=11.53, Time (ms)=26.37, FPS=38, Real-time=true2021.09 | 53.89 | — | — | — | — | — | — | — | — | — | 61.03 | — | — | — | |
| TrackAnythingevaluation=zero-shot, prompting=1 Point2025.07 | 52.46 | 54.9 | 55.35 | 47.59 | 28.71 | 43.27 | 82.75 | 63.1 | 66.46 | 55.54 | — | — | — | — | |
| ISINetCategory=Specialist2025.12 | 52.2 | 55.62 | 28.96 | 38.7 | 38.5 | 50.09 | 27.43 | 2.1 | 28.72 | 12.56 | — | — | — | — | |
| PAANetParam. (M)=21.86, FLOPS (G)=60.34, Time (ms)=38.2, FPS=262021.09 | 49.64 | — | — | — | — | — | — | — | — | — | 56.43 | — | — | — | |
| TDNetParam. (M)=21.23, FLOPS (G)=47.6, Time (ms)=22.23, FPS=45, Real-time=true2021.09 | 49.24 | — | — | — | — | — | — | — | — | — | 54.64 | — | — | — | |
| LWANetParam. (M)=2.25, FLOPS (G)=2.77, Time (ms)=13.21, FPS=76, Real-time=true2021.09 | 43.23 | — | — | — | — | — | — | — | — | — | 49.79 | — | — | — | |
| PerSAMevaluation=zero-shot2025.07 | 42.47 | 42.47 | 41.8 | 53.99 | 25.89 | 50.17 | 52.87 | 24.24 | 47.33 | 38.16 | — | — | — | — | |
| PerSAMCategory=SAM-based, Zero-Shot=true2025.12 | 42.47 | 42.47 | 41.8 | 53.99 | 25.89 | 50.17 | 52.87 | 24.24 | 47.33 | 38.16 | — | — | — | — | |
| MF-TAPNet2021.09 | 36.62 | — | — | — | — | — | — | — | — | — | 48.01 | — | — | — | |
| TernausNetParam. (M)=36.92, FLOPS (G)=275.45, Time (ms)=58.32, FPS=172021.09 | 33.78 | — | — | — | — | — | — | — | — | — | 44.95 | — | — | — | |
| CCTLabelled data ratio=10%2023.08 | — | — | — | — | — | — | — | — | — | — | 61.2 | — | — | 58.7 | |
| CCTLabelled data ratio=30%2023.08 | — | — | — | — | — | — | — | — | — | — | 69.6 | — | — | 65.5 | |
| ClassMixLabelled data ratio=10%2023.08 | — | — | — | — | — | — | — | — | — | — | 74.7 | — | — | 74.3 | |
| ClassMixLabelled data ratio=30%2023.08 | — | — | — | — | — | — | — | — | — | — | 78.6 | — | — | 72.9 | |
| CLIPSegResolution=448x448, GPU=A1002023.06 | — | — | — | — | — | — | — | — | — | — | — | 127 | 23 | — | |
| CRISResolution=416x416, GPU=A1002023.06 | — | — | — | — | — | — | — | — | — | — | — | 196 | 19 | — | |
| ISINetResolution=800x800, GPU=A1002023.06 | — | — | — | — | — | — | — | — | — | — | — | 264 | 19 | — | |
| MATISResolution=224x224, GPU=A1002023.06 | — | — | — | — | — | — | — | — | — | — | — | 66 | 27 | — | |
| Mean-teacherLabelled data ratio=10%2023.08 | — | — | — | — | — | — | — | — | — | — | 51.6 | — | — | 52.7 | |
| Mean-teacherLabelled data ratio=30%2023.08 | — | — | — | — | — | — | — | — | — | — | 60.2 | — | — | 59.9 | |
| Min-Max SimilarityLabelled data ratio=10%2023.08 | — | — | — | — | — | — | — | — | — | — | 79.4 | — | — | 77.9 | |
| Min-Max SimilarityLabelled data ratio=30%2023.08 | — | — | — | — | — | — | — | — | — | — | 87.1 | — | — | 76.4 | |
| PseudoSegLabelled data ratio=10%2023.08 | — | — | — | — | — | — | — | — | — | — | 79.8 | — | — | 78.7 | |
| PseudoSegLabelled data ratio=30%2023.08 | — | — | — | — | — | — | — | — | — | — | 87.8 | — | — | 75.5 | |
| SegMatchLabelled data ratio=10%2023.08 | — | — | — | — | — | — | — | — | — | — | 81.1 | — | — | 76.3 | |
| SegMatchLabelled data ratio=30%2023.08 | — | — | — | — | — | — | — | — | — | — | 89.2 | — | — | 72 | |
| TP-SISResolution=448x448, GPU=A1002023.06 | — | — | — | — | — | — | — | — | — | — | — | 125 | 22 | — | |
| WSSLLabelled data ratio=10%2023.08 | — | — | — | — | — | — | — | — | — | — | 62.6 | — | — | 73.2 | |
| WSSLLabelled data ratio=30%2023.08 | — | — | — | — | — | — | — | — | — | — | 60.4 | — | — | 70.2 |