Surgical Action Planning on CholecT50 (test)
47.37SLAcc Top-1Qwen2-VL-72B-SFT
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen2-VL-72B-SFTEvaluation Protocol=Supervised Fine-Tuning, HMM=DirNHFM2025.03 | 47.37 | 54.39 | 68.42 | 54.31 | 58.55 | 65.98 | 60.47 | 74.42 | 90.7 | 67.3 | 83.25 | 94.76 | |
| Qwen2.5-32BEvaluation Protocol=Zero-Shot, HMM=IndirNHFM2025.03 | 45.61 | 63.16 | 66.67 | 53.42 | 62.48 | 64.65 | 67.44 | 95.35 | 97.67 | 78.97 | 97.38 | 98.33 | |
| Qwen2.5-72BEvaluation Protocol=Zero-Shot, HMM=IndirNHFM2025.03 | 45.61 | 59.65 | 66.67 | 53.42 | 59.31 | 64.65 | 67.44 | 83.72 | 97.67 | 78.97 | 89.21 | 99.05 | |
| Qwen2.5-72B-SFTEvaluation Protocol=Supervised Fine-Tuning2025.03 | 45.61 | 78.95 | 80.7 | 53.42 | 80.05 | 82.27 | 67.44 | 93.02 | 97.67 | 78.97 | 93.33 | 98.33 | |
| Qwen2.5-32B-SFTEvaluation Protocol=Supervised Fine-Tuning, HMM=IndirNHFM2025.03 | 45.61 | 78.95 | 85.96 | 53.42 | 83.05 | 87.89 | 67.44 | 95.35 | 97.67 | 78.97 | 96.67 | 98.33 | |
| Qwen2-VLEvaluation Protocol=Zero-Shot, HMM=DirNHFM2025.03 | 40.35 | 57.89 | 68.42 | 48.37 | 56.37 | 66.32 | 72.09 | 88.37 | 90.7 | 82.48 | 93.45 | 95.24 |