Radiology Report Evaluation on Open-i 50-sample benchmark
100D ScoreRadFact
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RadFactType=Baseline2026.06 | 100 | 100 | 100 | 0 | |
| FineRadScoreType=Baseline2026.06 | 100 | 100 | 100 | 0 | |
| Claude Sonnet 4.5Type=Proprietary2026.06 | 100 | 100 | 100 | 0 | |
| Qwen3-8BType=Open-source2026.06 | 100 | 76 | 88 | 24 | |
| Qwen3-8B + SFT + RLType=Open-source2026.06 | 100 | 96 | 98 | 4 | |
| MedGemma-4BType=Open-source2026.06 | 100 | 92 | 96 | 8 | |
| MedGemma-4B + SFT + RLType=Open-source2026.06 | 100 | 100 | 100 | 0 | |
| CRIMSONType=Baseline2026.06 | 92 | 100 | 96 | 8 |