Visual Question Answering on Open-ended PitVQA (External val)
0.441BLEUQwen2.5
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Qwen2.5Evaluation Protocol=Zero-shot2025.11 | 0.441 | 0.588 | 0.632 | 0.54 | 0.682 | 0.721 | 0.587 | 0.515 | 0.617 | |
| SurgicalGPTEvaluation Protocol=PEFT2025.11 | 0.415 | 0.378 | 0.301 | 0.904 | 0.746 | 0.569 | 0.881 | 0.79 | 0.83 | |
| MedGemma3.0Evaluation Protocol=Zero-shot2025.11 | 0.263 | 0.321 | 0.359 | 0.56 | 0.54 | 0.687 | 0.755 | 0.538 | 0.636 | |
| PitVQAEvaluation Protocol=PEFT2025.11 | 0.135 | 0.114 | 0.05 | 0.888 | 0.946 | 0.691 | 0.926 | 0.587 | 0.504 | |
| Llama3.2Evaluation Protocol=Zero-shot2025.11 | 0.124 | 0.21 | 0.3 | 0.819 | 0.937 | 0.54 | 0.834 | 0.555 | 0.527 |