Absence detection on OpenI report-style absence
70.47Base AccuracyMedGemma
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| MedGemmaChain-of-Thought (CoT)=false2026.05 | 70.47 | 86.91 | 16.44 | 79 | |
| LLaVA-MedChain-of-Thought (CoT)=false2026.05 | 49.03 | 49.58 | 0.55 | 4 | |
| MedGemmaChain-of-Thought (CoT)=true2026.05 | 45.68 | 78.55 | 32.87 | 177 | |
| LLaVA-1.5Chain-of-Thought (CoT)=false2026.05 | 40.39 | 72.42 | 32.03 | 212 | |
| LLaVA-MedChain-of-Thought (CoT)=true2026.05 | 38.72 | 80.5 | 41.78 | 218 | |
| GPT-4oChain-of-Thought (CoT)=false2026.05 | 16.16 | 63.79 | 47.63 | 284 | |
| MedGemmaModel size=27B, Chain-of-Thought (CoT)=false2026.05 | 15.32 | 52.37 | 37.05 | 199 | |
| Qwen2.5-VLChain-of-Thought (CoT)=true2026.05 | 14.76 | 52.92 | 38.16 | 288 | |
| Qwen2.5-VLChain-of-Thought (CoT)=false2026.05 | 12.53 | 64.35 | 51.82 | 311 | |
| CheXagentChain-of-Thought (CoT)=false2026.05 | 2.51 | 30.08 | 27.57 | 189 |