Diagnostic Classification on MIMIC-CXR Edema vs. Pneumonia (test)
70.9AccuracyGemini-3-Pro
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Gemini-3-Pro2026.02 | 70.9 | 70.9 | 0.419 | |
| CAREBase Model=Gemini-3-Flash, Strategy=CARE2026.02 | 64.6 | 61.9 | 0.287 | |
| Blind-CAREBase Model=Gemini-3-Flash, Strategy=Blind-CARE, Access to original image=false2026.02 | 61.8 | 56.3 | 0.228 | |
| Gemini-3-Flash (Self-Check 3x)Base Model=Gemini-3-Flash, Strategy=Self-Check, Number of passes=3x, Multi-pass self-revision=true2026.02 | 61 | 55.1 | 0.208 | |
| Gemini-3-Flash (Self-Check 2x)Base Model=Gemini-3-Flash, Strategy=Self-Check, Number of passes=2x, Multi-pass self-revision=true2026.02 | 60.6 | 54.6 | 0.2 | |
| Gemini-3-Flash (Baseline)Base Model=Gemini-3-Flash, Strategy=Baseline2026.02 | 60.2 | 53.9 | 0.197 | |
| Gemini-3-Flash (Majority-Vote 3x)Base Model=Gemini-3-Flash, Strategy=Majority-Vote, Number of sampling=3x, Independent sampling with majority aggregation=true2026.02 | 60.1 | 53.3 | 0.195 | |
| Qwen3-VL-32BParameters=32B2026.02 | 56.4 | 50.4 | 0.116 | |
| Qwen3-VL-8BParameters=8B2026.02 | 55.9 | 54.2 | 0.119 | |
| BiomedCLIP2026.02 | 55.7 | 55.4 | 0.114 | |
| GLM-4.6V-Flash2026.02 | 55.2 | 51.3 | 0.088 | |
| SigLIP22026.02 | 50.2 | 34.9 | 0.006 | |
| InternVL3-14BParameters=14B2026.02 | 50.2 | 36.1 | 0.002 | |
| MedVLM-R12026.02 | 49.8 | 33.6 | -0.003 | |
| Gemma-3-12BParameters=12B2026.02 | 47.6 | 45.5 | -0.041 |