Classification on PneumoniaMNIST MedMNIST v2 (test)
99.4AccuracyMedGemma3-4B + PCDF (Ours)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MedGemma3-4B + PCDF (Ours)Setting=PCDF-enabled2026.01 | 99.4 | 99.3 | — | |
| MedGemma3-4BSetting=Image-only SFT2026.01 | 99.2 | 99.1 | — | |
| Gemma3-4B + PCDF (Ours)Setting=PCDF-enabled2026.01 | 99 | 99 | — | |
| InternVL3-2B + PCDF (Ours)Setting=PCDF-enabled2026.01 | 98.7 | 98.6 | — | |
| Med ViT smallEvaluation Protocol=Full fine-tuning2026.02 | 96.1 | — | 99.5 | |
| Gemma3-4BSetting=Image-only SFT2026.01 | 96 | 95.7 | — | |
| Qwen2.5-VL-7B + PCDF (Ours)Setting=PCDF-enabled2026.01 | 95 | 94.5 | — | |
| Med ViT tinyEvaluation Protocol=Full fine-tuning2026.02 | 94.9 | — | 99.3 | |
| Google AutoML VisionEvaluation Protocol=Full fine-tuning2026.02 | 94.6 | — | 99.1 | |
| R-LLMEvaluation Protocol=Full fine-tuning2026.02 | 93.91 | — | 98.01 | |
| ResNet50Setting=Image-only SFT2026.01 | 92.3 | 91.4 | — | |
| Med ViT baseEvaluation Protocol=Full fine-tuning2026.02 | 92.1 | — | 99.1 | |
| DenseNet201Setting=Image-only SFT2026.01 | 91.8 | 90.8 | — | |
| BioMedCLIPSetting=Image-only SFT2026.01 | 90.8 | 89.7 | — | |
| InternVL3-2BSetting=Image-only SFT2026.01 | 89.6 | 88.4 | — | |
| Resnet50Evaluation Protocol=Full fine-tuning2026.02 | 88.4 | — | 96.2 | |
| AutoKerasEvaluation Protocol=Full fine-tuning2026.02 | 87.8 | — | 94.7 | |
| GCNN-ECEvaluation Protocol=Full fine-tuning2026.02 | 87.7 | — | 95.4 | |
| MedCLIPSetting=Image-only SFT2026.01 | 87.2 | 85.3 | — | |
| Resnet18Evaluation Protocol=Full fine-tuning2026.02 | 86.4 | — | 95.6 | |
| Qwen2.5-VL-7BSetting=Image-only SFT2026.01 | 85.6 | 83.3 | — | |
| auto-sklearnEvaluation Protocol=Full fine-tuning2026.02 | 85.5 | — | 94.2 | |
| PMC-CLIPSetting=Image-only SFT2026.01 | 84.5 | 81.7 | — | |
| CLIPSetting=Image-only SFT2026.01 | 82.9 | 79.8 | — | |
| InternVL3-2BSetting=Zero-Shot2026.01 | 71.2 | 63.8 | — | |
| MedCLIPSetting=Zero-Shot2026.01 | 62.5 | 38.5 | — | |
| Gemma3-4BSetting=Zero-Shot2026.01 | 61.9 | 41.5 | — | |
| BioMedCLIPSetting=Zero-Shot2026.01 | 56.7 | 48 | — | |
| PMC-CLIPSetting=Zero-Shot2026.01 | 46.8 | 46.3 | — | |
| MedGemma3-4BSetting=Zero-Shot2026.01 | 45.8 | 40.8 | — | |
| Qwen2.5-VL-7BSetting=Zero-Shot2026.01 | 39.4 | 32.6 | — | |
| CLIPSetting=Zero-Shot2026.01 | 37.5 | 27.3 | — |