Surgical Error Detection on JIGSAWS
76F1 ScoreActivity-Aware Multimodal Fusion
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Activity-Aware Multimodal FusionActivity Knowledge=Gesture+Error, Inputs=Img+Txt+Kin2026.06 | 76 | 71.7 | 63.4 | 5 | |
| Activity PromptingActivity Knowledge=Gesture+Error, Inputs=Img+Txt2026.06 | 74.5 | 69.2 | 58.8 | 2.9 | |
| Activity PromptingActivity Knowledge=Interaction+Error, Inputs=Img+Txt2026.06 | 73 | 67.1 | 55.3 | 0.8 | |
| CoG (GVR only)Activity Knowledge=Gestures, Inputs=Img+Txt2026.06 | 72.4 | 66.3 | 57 | 0 | |
| ResNetActivity Knowledge=-, Inputs=Img2026.06 | 71.9 | 65.8 | 59.1 | -0.7 | |
| Siamese-LSTM (G*T*)Activity Knowledge=-, Inputs=Kin2026.06 | 70 | 65 | 53 | -3.3 | |
| SEDMambaActivity Knowledge=-, Inputs=Img2026.06 | 68.3 | 63.4 | 52.2 | -5.7 |