Chest X-ray classification on MIMIC-CXR Med-Gemini (test)
90.7Macro F1Med-Gemini
Evaluation results
| Method | Links | |
|---|---|---|
| Med-GeminiModel size category=SOTA VLM, Evaluation protocol=zero-shot2025.07 | 90.7 | |
| MedGemma 1Model Scale=27B, Temperature=0.02026.04 | 90 | |
| MedGemma 1.5Model Scale=4B, Temperature=0.02026.04 | 89.5 | |
| MedGemma 4BModel size category=Small Models, Evaluation protocol=zero-shot2025.07 | 88.9 | |
| MedGemma 1Model Scale=4B, Temperature=0.02026.04 | 88.9 | |
| Gemini 3 FlashTemperature=default2026.04 | 88.4 | |
| Gemini v2.5 ProModel size category=Large Models, Evaluation protocol=zero-shot2025.07 | 85.8 | |
| Gemini 3 ProTemperature=default2026.04 | 85 | |
| Gemma 3 4BModel size category=Small Models, Evaluation protocol=zero-shot2025.07 | 81.2 | |
| Gemini v2.5 FlashModel size category=Large Models, Evaluation protocol=zero-shot2025.07 | 81 | |
| Qwen3 VLModel Scale=4B, Temperature=default2026.04 | 78.5 | |
| Gemma 3 27BModel size category=Small Models, Evaluation protocol=zero-shot2025.07 | 71.7 |