Medical Visual Question Answering on OBScan Open
81.11RecallPhi3.5V-Med
Evaluation results
| Method | Links | |
|---|---|---|
| Phi3.5V-MedEvaluation Protocol=Fine-Tuning, Decoding Strategy=ARCD2025.12 | 81.11 | |
| Phi3.5V-MedEvaluation Protocol=Fine-Tuning, Decoding Strategy=VCD2025.12 | 75.56 | |
| Phi3.5V-MedEvaluation Protocol=Fine-Tuning, Decoding Strategy=Greedy2025.12 | 74.44 | |
| Phi3.5V-MedEvaluation Protocol=Fine-Tuning, Decoding Strategy=DoLA2025.12 | 73.33 | |
| GPT-4oEvaluation Protocol=General Domain, Decoding Strategy=Greedy2025.12 | 72.22 | |
| Phi3.5V-MedEvaluation Protocol=Fine-Tuning, Decoding Strategy=OPERA2025.12 | 65.56 | |
| Phi3.5V-MedEvaluation Protocol=Zero-Shot, Decoding Strategy=VCD2025.12 | 61.11 | |
| Phi3.5V-MedEvaluation Protocol=Zero-Shot, Decoding Strategy=ARCD2025.12 | 61.11 | |
| HuatuoV-34BEvaluation Protocol=Zero-Shot, Decoding Strategy=Greedy2025.12 | 60 | |
| Phi3.5V-MedEvaluation Protocol=Zero-Shot, Decoding Strategy=OPERA2025.12 | 60 | |
| Phi3.5V-MedEvaluation Protocol=Zero-Shot, Decoding Strategy=DoLA2025.12 | 57.78 | |
| Phi3.5V-MedEvaluation Protocol=Zero-Shot, Decoding Strategy=Greedy2025.12 | 54.44 | |
| LLaVA-Med-7BEvaluation Protocol=Zero-Shot, Decoding Strategy=Greedy2025.12 | 52.22 | |
| Qwen-VL-7BEvaluation Protocol=General Domain, Decoding Strategy=Greedy2025.12 | 48.89 | |
| LLaVA-1.6-7BEvaluation Protocol=General Domain, Decoding Strategy=Greedy2025.12 | 47.78 | |
| Phi3.5V-4.2BEvaluation Protocol=General Domain, Decoding Strategy=Greedy2025.12 | 40 |