Surgical Instrument Segmentation on EndoVis 2018 (test)
88.24Ch_IoUReMeDI-SAM3
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ReMeDI-SAM3Category=SAM-based, Setting=Training-free2025.12 | 88.24 | — | 87.63 | 80.12 | 91.66 | 64.33 | 81.01 | 90.41 | 80.44 | 87.46 | 82.23 | — | — | |
| SAM3Category=SAM-based, Zero-Shot=true2025.12 | 88.04 | — | 82.25 | 74.92 | 88.14 | 53.75 | 32.96 | 88.38 | 44.78 | 81.82 | 66.46 | — | — | |
| IR-SIS2026.02 | 85.44 | — | 87.99 | 82.69 | 49.65 | 86.41 | 31.12 | 92.86 | 79.39 | — | 72.87 | — | — | |
| TP-SISResolution=896, Method Type=Text Promptable2023.06 | 84.92 | 83.61 | 84.28 | 73.18 | 78.88 | 92.2 | 23.73 | 66.67 | 39.12 | 65.44 | — | — | — | |
| TP-SISInput Resolution=8962026.02 | 84.92 | — | 84.28 | 73.18 | 78.88 | 92.2 | 23.73 | 66.67 | 39.12 | — | 65.44 | — | — | |
| TP-SISCategory=Specialist2025.12 | 84.92 | — | 84.28 | 73.18 | 78.88 | 92.2 | 23.73 | 66.67 | 39.12 | 83.61 | 65.44 | — | — | |
| MATISMethod Type=Conventional Supervised2023.06 | 84.26 | 79.12 | 83.52 | 41.9 | 66.18 | 70.57 | 0 | 92.96 | 23.13 | 54.04 | — | — | — | |
| MATIS2026.02 | 84.26 | — | 83.52 | 41.9 | 66.18 | 70.57 | 0 | 92.96 | 23.13 | — | 54.04 | — | — | |
| SP-SAMCategory=SAM-based2025.12 | 84.24 | — | 87.6 | 65.07 | 61.95 | 58.3 | 59.96 | 92.08 | 34.99 | 84.24 | 65.71 | — | — | |
| TP-SISResolution=448, Method Type=Text Promptable2023.06 | 82.67 | 81.54 | 81.53 | 70.18 | 71.54 | 90.58 | 21.46 | 65.57 | 57.51 | 65.48 | — | — | — | |
| TP-SISInput Resolution=4482026.02 | 82.67 | — | 81.53 | 70.18 | 71.54 | 90.58 | 21.46 | 65.57 | 57.51 | — | 65.48 | — | — | |
| MATIS FrameCategory=Specialist2025.12 | 82.37 | — | 83.35 | 38.82 | 40.19 | 64.49 | 4.32 | 93.18 | 16.17 | 77.01 | 48.65 | — | — | |
| SurgicalSAMCategory=SAM-based2025.12 | 80.33 | — | 83.66 | 65.63 | 58.75 | 54.48 | 39.78 | 88.56 | 21.23 | 80.33 | 58.87 | — | — | |
| TraSeTRMethod Type=Conventional Supervised2023.06 | 76.2 | — | 76.3 | 53.3 | 46.5 | 40.6 | 13.9 | 86.3 | 17.5 | 47.77 | — | — | — | |
| TraSeTR2026.02 | 76.2 | — | 76.3 | 53.3 | 46.5 | 40.6 | 13.9 | 86.3 | 17.5 | — | 47.77 | — | — | |
| S3NetMethod Type=Conventional Supervised2023.06 | 75.81 | 74.02 | 77.22 | 50.87 | 19.83 | 50.59 | 0 | 92.12 | 7.44 | 42.58 | — | — | — | |
| S3Net2026.02 | 75.81 | — | 77.22 | 50.87 | 19.83 | 50.59 | 0 | 92.12 | 7.44 | — | 42.58 | — | — | |
| S3NetCategory=Specialist2025.12 | 75.81 | — | 77.22 | 50.87 | 19.83 | 50.59 | 0 | 92.12 | 7.44 | 74.02 | 42.58 | — | — | |
| CLIPSegMethod Type=Text Promptable2023.06 | 74.95 | 69.86 | 67.25 | 39.59 | 36.72 | 47.27 | 2.92 | 79.96 | 4.22 | 39.7 | — | — | — | |
| CLIPSeg2026.02 | 74.95 | — | 67.25 | 39.59 | 36.72 | 47.27 | 2.92 | 79.96 | 4.22 | — | 39.7 | — | — | |
| CRISMethod Type=Text Promptable2023.06 | 74.1 | 72.29 | 73.58 | 58.2 | 47.64 | 72.14 | 4.56 | 45.99 | 20.18 | 46.04 | — | — | — | |
| CRIS2026.02 | 74.1 | — | 73.58 | 58.2 | 47.64 | 72.14 | 4.56 | 45.99 | 20.18 | — | 46.04 | — | — | |
| ISINetMethod Type=Conventional Supervised2023.06 | 73.03 | 70.97 | 73.83 | 48.61 | 30.98 | 37.68 | 0 | 88.16 | 2.16 | 40.21 | — | — | — | |
| ISINet2026.02 | 73.03 | — | 73.83 | 48.61 | 30.98 | 37.68 | 0 | 88.16 | 2.16 | — | 40.21 | — | — | |
| ISINetCategory=Specialist2025.12 | 73.03 | — | 73.83 | 48.61 | 30.98 | 37.68 | 0 | 88.16 | 2.16 | 70.94 | 40.21 | — | — | |
| MF-TAPNetMethod Type=Conventional Supervised2023.06 | 67.87 | 39.14 | 69.23 | 6.1 | 11.68 | 14 | 0.91 | 70.24 | 0.57 | 24.68 | — | — | — | |
| MF-TAPNet2026.02 | 67.87 | — | 69.23 | 6.1 | 11.68 | 14 | 0.91 | 70.24 | 0.57 | — | 24.68 | — | — | |
| TP-SISResolution=896, Method Type=Text Promptable, Evaluation Protocol=Cross-dataset experiment2023.06 | 66.25 | 64.92 | 65.81 | 56.12 | 44.72 | 79.77 | 1.22 | 8.97 | 4.77 | 37.34 | — | — | — | |
| TrackAnythingCategory=SAM-based2025.12 | 65.72 | — | 72.9 | 31.07 | 64.73 | 10.24 | 12.28 | 61.05 | 17.93 | 60.88 | 38.6 | — | — | |
| PerSAMCategory=SAM-based, Zero-Shot=true2025.12 | 49.21 | — | 51.26 | 34.4 | 46.75 | 16.45 | 15.07 | 52.28 | 25.62 | 49.21 | 34.55 | — | — | |
| TernausNet-11Method Type=Conventional Supervised2023.06 | 46.22 | 39.87 | 44.2 | 4.67 | 0 | 0 | 0 | 50.44 | 0 | 14.19 | — | — | — | |
| TernausNet-112026.02 | 46.22 | — | 44.2 | 4.67 | 0 | 0 | 0 | 50.44 | 0 | — | 14.19 | — | — |