Finding Extraction on ChestX-CN 150-report (val)
99.3AtelectasisQwen3-14B
Evaluation Results
| Method | Links | |||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3-14BPrompt Type=Few-shot (optimized on MIMIC-CXR-EN), Language Mode=Zero-shot cross-lingual2026.03 | 99.3 | 98 | 98.7 | 100 | 100 | 99.3 | 92 | 94.7 | 96 | 90.7 | 89.3 | 89.3 | 97.3 | 96.7 | 99.3 | 100 | 97.3 | 98.7 | 100 | 99.3 | 100 | |
| DeepSeek-R1Prompt Type=Few-shot (optimized on MIMIC-CXR-EN), Language Mode=Zero-shot cross-lingual2026.03 | 98.7 | 99.3 | 98 | 100 | 99.3 | 98 | 78 | 92.7 | 96 | 97.3 | 69.3 | 82.7 | 96.7 | 95.3 | 100 | 99.3 | 96 | 98 | 96.7 | 98 | 100 | |
| GPT-4o-miniPrompt Type=Few-shot (optimized on MIMIC-CXR-EN), Language Mode=Zero-shot cross-lingual2026.03 | 94 | 98.7 | 96 | 100 | 99.3 | 100 | 95.3 | 94.7 | 96.7 | 69.3 | 76 | 82.7 | 96 | 90.7 | 99.3 | 97.3 | 96.7 | 100 | 98.7 | 98 | 100 | |
| Qwen-PlusPrompt Type=Few-shot (optimized on MIMIC-CXR-EN), Language Mode=Zero-shot cross-lingual2026.03 | 92 | 99.3 | 96 | 100 | 99.3 | 97.3 | 90.7 | 91.3 | 95.3 | 98 | 89.3 | 90 | 96 | 94 | 100 | 98 | 96.7 | 97.3 | 90 | 99.3 | 100 | |
| GPT-3.5-turboPrompt Type=Few-shot (optimized on MIMIC-CXR-EN), Language Mode=Zero-shot cross-lingual2026.03 | 27.3 | 15.3 | 46 | 26.7 | 70 | 94.7 | 68.7 | 90 | 45.3 | 29.3 | 70.7 | 54 | 64 | 82 | 76.7 | 39.3 | 52 | 32.7 | 44 | 60 | 66.7 |