Medical Image Classification on RetinaMNIST v2 (test)
82.2AccuracyMedGemma3-4B + PCDF (Ours)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MedGemma3-4B + PCDF (Ours)Setting=PCDF-enabled2026.01 | 82.2 | — | — | — | 81.3 | |
| MedGemma3-4BSetting=Image-only SFT2026.01 | 79.2 | — | — | — | 71.2 | |
| Gemma3-4B + PCDF (Ours)Setting=PCDF-enabled2026.01 | 76 | — | — | — | 67.7 | |
| InternVL3-2B + PCDF (Ours)Setting=PCDF-enabled2026.01 | 72.2 | — | — | — | 54.9 | |
| MedGemma3-4BSetting=Zero-Shot2026.01 | 66.2 | — | — | — | 47.7 | |
| Gemma3-4BSetting=Image-only SFT2026.01 | 64.8 | — | — | — | 47.7 | |
| DenseNet201Setting=Image-only SFT2026.01 | 62.5 | — | — | — | 50.2 | |
| ResNet50Setting=Image-only SFT2026.01 | 59.5 | — | — | — | 35 | |
| BioMedCLIPSetting=Image-only SFT2026.01 | 58.2 | — | — | — | 42.6 | |
| Qwen2.5-VL-7B + PCDF (Ours)Setting=PCDF-enabled2026.01 | 58.2 | — | — | — | 39.7 | |
| Qwen2.5-VL-7BSetting=Image-only SFT2026.01 | 54.8 | — | — | — | 33.8 | |
| FL+AUCOCLLoss function=FL + AUCOC Loss2023.08 | 53.58 | 0.7231 | 39.42 | 56.12 | — | |
| CE+AUCOCLLoss function=CE + AUCOC Loss2023.08 | 53.1 | 0.7247 | 38.33 | 53.81 | — | |
| CLIPSetting=Image-only SFT2026.01 | 52.8 | — | — | — | 34.4 | |
| InternVL3-2BSetting=Image-only SFT2026.01 | 52.5 | — | — | — | 31.5 | |
| FLgamma=3, Loss function=Focal Loss2023.08 | 52.25 | 0.6857 | 44.25 | 58.25 | — | |
| PMC-CLIPSetting=Image-only SFT2026.01 | 52.2 | — | — | — | 32.2 | |
| CELoss function=Cross-Entropy2023.08 | 52.1 | 0.7145 | 39.53 | 68.58 | — | |
| CE+S-ECELoss function=CE + Soft-ECE2023.08 | 52.05 | 0.714 | 39.45 | 55.83 | — | |
| FL+S-AvUCLoss function=FL + Soft-AvUC2023.08 | 52 | 0.668 | 45.58 | 70.54 | — | |
| CE+S-AvUCLoss function=CE + Soft-AvUC2023.08 | 51.42 | 0.6815 | 42.71 | 62.29 | — | |
| FL+S-ECELoss function=FL + Soft-ECE2023.08 | 51.33 | 0.7049 | 42.42 | 79.91 | — | |
| FL+MMCELoss function=FL + Maximum Mean Calibration Error2023.08 | 50.33 | 0.6708 | 47.5 | 78.91 | — | |
| AdaFL53Loss function=AdaFL532023.08 | 48.58 | 0.6885 | 48.67 | 62 | — | |
| CE+MMCELoss function=CE + Maximum Mean Calibration Error2023.08 | 48.5 | 0.6918 | 42.92 | 69.13 | — | |
| MedCLIPSetting=Image-only SFT2026.01 | 43.8 | — | — | — | 13.3 | |
| CLIPSetting=Zero-Shot2026.01 | 43.5 | — | — | — | 12.1 | |
| Qwen2.5-VL-7BSetting=Zero-Shot2026.01 | 27 | — | — | — | 19.7 | |
| InternVL3-2BSetting=Zero-Shot2026.01 | 23.2 | — | — | — | 8.1 | |
| Gemma3-4BSetting=Zero-Shot2026.01 | 15 | — | — | — | 12.4 | |
| PMC-CLIPSetting=Zero-Shot2026.01 | 13.8 | — | — | — | 12.1 | |
| BioMedCLIPSetting=Zero-Shot2026.01 | 13.5 | — | — | — | 11.7 | |
| MedCLIPSetting=Zero-Shot2026.01 | 6.5 | — | — | — | 5.3 |