Surgical Video Question Answering on CholeVidQA-32K
71.62CR ScoreSurgTEMP
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SurgTEMPEvaluation Protocol=Fine-tuned2026.03 | 71.62 | 81.65 | 79.12 | 15.29 | 36.28 | 34.9 | 42.53 | 56.53 | 100 | 52.33 | 91 | |
| VideoGPT+-ftEvaluation Protocol=Fine-tuned2026.03 | 64.06 | 73.58 | 71.63 | 14.62 | 33.29 | 31.87 | 42.33 | 52.37 | 95 | 49.3 | 82 | |
| LLaVA-Video-ftEvaluation Protocol=Fine-tuned2026.03 | 60.05 | 67.3 | 65.56 | 14.67 | 32.44 | 31.41 | 40.85 | 51.31 | 88 | 44.2 | 63 | |
| VideoGPT+Evaluation Protocol=Open-source Zero-shot2026.03 | 36.65 | 48.32 | 46.61 | 3.83 | 21.96 | 22.68 | 14.19 | 40.2 | 68 | 25.13 | 78 | |
| LLaVA-VideoEvaluation Protocol=Open-source Zero-shot2026.03 | 33.29 | 41.07 | 38.72 | 3.76 | 21.39 | 17.2 | 4.01 | 27.34 | 49 | 12.56 | 65 | |
| mPLUG-Owl3Evaluation Protocol=Open-source Zero-shot2026.03 | 32.06 | 45 | 43.09 | 5.57 | 23.81 | 23.12 | 6.4 | 32.29 | 95 | 15 | 97 | |
| LongVAEvaluation Protocol=Open-source Zero-shot2026.03 | 25.81 | 34.9 | 34.68 | 1.91 | 21.61 | 14.21 | 0.61 | 5.07 | 9 | 22.46 | 56 | |
| InternVideo2.5Evaluation Protocol=Open-source Zero-shot2026.03 | 16.28 | 19.38 | 16.56 | 2.93 | 8.87 | 9.78 | 4.67 | 25.71 | 91 | 1.24 | 7 |