Visual Question Answering on EndoVis18-VQA Out-of-template (val)
0.474BLEUPitVQA
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| PitVQAEvaluation Protocol=PEFT2025.11 | 0.474 | 0.468 | 0.454 | 0.547 | 0.588 | 0.5 | 0.76 | 0.553 | 0.739 | |
| SurgicalGPTEvaluation Protocol=PEFT2025.11 | 0.373 | 0.439 | 0.449 | 0.617 | 0.795 | 0.5 | 0.502 | 0.546 | 0.505 | |
| Qwen2.5Evaluation Protocol=Zero-shot2025.11 | 0.28 | 0.325 | 0.337 | 0.553 | 0.554 | 0.556 | 0.601 | 0.598 | 0.54 | |
| Llama3.2Evaluation Protocol=Zero-shot2025.11 | 0.201 | 0.337 | 0.357 | 0.673 | 0.638 | 0.532 | 0.663 | 0.527 | 0.528 | |
| MedGemma3.0Evaluation Protocol=Zero-shot2025.11 | 0.167 | 0.267 | 0.272 | 0.507 | 0.798 | 0.561 | 0.816 | 0.511 | 0.699 |