Action Quality Assessment on JIGSAWS
0.84Correlation (Suturing)CoRe + GART
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CoRe + GARTour implementation=true2021.08 | 0.84 | 0.86 | 0.86 | 0.85 | — | — | 5.055 | 5.688 | 2.927 | 4.556 | — | |
| MUSDL2020.06 | 0.71 | 0.69 | 0.71 | 0.7 | — | — | — | — | — | — | — | |
| MUSDL2021.08 | 0.71 | 0.69 | 0.71 | 0.7 | — | — | — | — | — | — | — | |
| MTL-VF (C3D)Input=Videos (V), Extra surgical experience annotations=true2021.06 | 0.69 | 0.86 | 0.83 | 0.8 | — | — | — | — | — | — | — | |
| MTL-VF (ResNet)Input=Videos (V), Extra surgical experience annotations=true2021.06 | 0.68 | 0.48 | 0.72 | 0.64 | — | — | — | — | — | — | — | |
| USDL2020.06 | 0.64 | 0.63 | 0.61 | 0.63 | — | — | — | — | — | — | — | |
| USDL2021.08 | 0.64 | 0.63 | 0.61 | 0.63 | — | — | — | — | — | — | — | |
| I3D + MLPour implementation=true2021.08 | 0.61 | 0.68 | 0.66 | 0.65 | — | — | 4.795 | 11.225 | 6.12 | 7.373 | — | |
| AIMInput=Videos + Kinematics (VK)2021.06 | 0.45 | 0.34 | 0.61 | 0.47 | — | — | — | — | — | — | — | |
| unified multi-path framework (VTP)Input=Videos + Kinematics (VK)2021.06 | 0.45 | 0.62 | 0.58 | 0.56 | — | — | — | — | — | — | — | |
| unified multi-path framework (VTPE)Input=Videos + Kinematics (VK), Extra surgical experience annotations=false2021.06 | 0.45 | 0.65 | 0.59 | 0.57 | — | — | — | — | — | — | — | |
| unified multi-path framework (TP)Input=Kinematics (K)2021.06 | 0.4 | 0.63 | 0.55 | 0.53 | — | — | — | — | — | — | — | |
| DTC+DFT+ApEnInput=Kinematics (K)2021.06 | 0.37 | 0.25 | 0.6 | 0.41 | — | — | — | — | — | — | — | |
| JRG2020.06 | 0.36 | 0.54 | 0.75 | 0.57 | — | — | — | — | — | — | — | |
| JRG2021.08 | 0.36 | 0.54 | 0.75 | 0.57 | — | — | — | — | — | — | — | |
| JRGInput=Videos + Kinematics (VK)2021.06 | 0.35 | 0.67 | 0.19 | 0.4 | — | — | — | — | — | — | — | |
| TSN2020.06 | 0.34 | 0.23 | 0.72 | 0.46 | — | — | — | — | — | — | — | |
| TSN2021.08 | 0.34 | 0.23 | 0.72 | 0.46 | — | — | — | — | — | — | — | |
| ST-GCN2020.06 | 0.31 | 0.39 | 0.58 | 0.43 | — | — | — | — | — | — | — | |
| ST-GCN2021.08 | 0.31 | 0.39 | 0.58 | 0.43 | — | — | — | — | — | — | — | |
| DinoV3-HModel Variant=H2026.02 | — | — | — | — | 3.707 | 0.4167 | — | — | — | — | — | |
| DinoV3-LModel Variant=L2026.02 | — | — | — | — | 3.9895 | 0.4159 | — | — | — | — | — | |
| EndoFM2026.02 | — | — | — | — | 4.0895 | 0.4465 | — | — | — | — | — | |
| EndoSSL2026.02 | — | — | — | — | 4.2182 | 0.3986 | — | — | — | — | — | |
| EndoViT2026.02 | — | — | — | — | 4.1 | 0.4431 | — | — | — | — | — | |
| GastroNet2026.02 | — | — | — | — | 3.5962 | 0.5002 | — | — | — | — | — | |
| Gemini 2.52026.06 | — | — | — | — | — | 0.1 | — | — | — | — | 33.13 | |
| GPT-4o2026.06 | — | — | — | — | — | 0.09 | — | — | — | — | 71.61 | |
| GSViT2026.02 | — | — | — | — | 4.7528 | — | — | — | — | — | — | |
| LLaVA-Video2026.06 | — | — | — | — | — | 0.41 | — | — | — | — | 40.61 | |
| LVDRvariant=∆ Diffusion2026.06 | — | — | — | — | — | 0.65 | — | — | — | — | 10.73 | |
| LVDR2026.06 | — | — | — | — | — | 0.69 | — | — | — | — | 9.93 | |
| MAGR2026.06 | — | — | — | — | — | 0.48 | — | — | — | — | 10.6 | |
| MAGR++2026.06 | — | — | — | — | — | 0.55 | — | — | — | — | 10.2 | |
| Qwen-2.5-VL-7B2026.06 | — | — | — | — | — | 0.03 | — | — | — | — | 67.48 | |
| Selfsupsurg2026.02 | — | — | — | — | 4.0229 | — | — | — | — | — | — | |
| SurgNetXLModel Variant=XL2026.02 | — | — | — | — | 4.7663 | 0.0509 | — | — | — | — | — | |
| SurgVLP2026.02 | — | — | — | — | 3.9817 | 0.4071 | — | — | — | — | — | |
| UniSurg2026.02 | — | — | — | — | 2.649 | 0.77 | — | — | — | — | — | |
| VideoMAE-GModel Variant=G2026.02 | — | — | — | — | 3.972 | 0.3362 | — | — | — | — | — | |
| VideoMAE-LModel Variant=L2026.02 | — | — | — | — | 3.9189 | 0.4174 | — | — | — | — | — |