Medical Conditions Extraction on DISPLACE-M (eval)
45.6ROUGE-1Gemini 3 Pro
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemini 3 Proshot_count=0-shot, input_modality=Audio2026.03 | 45.6 | 43.55 | |
| Gemini 3 Proshot_count=0-shot, input_modality=Audio + Transcript2026.03 | 43.62 | 42.07 | |
| Gemini 3 Proshot_count=6-shot, input_modality=Audio + Transcript2026.03 | 41.61 | 39.73 | |
| Gemini 3 Proshot_count=6-shot, input_modality=Audio2026.03 | 38.78 | 38.29 | |
| Claude Opus 4.1Model source=Closed-Source, Prompting strategy=6-Shot2026.03 | 34.9 | 32.72 | |
| Gemini 3 ProModel source=Closed-Source, Prompting strategy=6-Shot2026.03 | 32.36 | 30.72 | |
| Gemini 3 Proshot_count=0-shot, input_modality=Audio + Conditions List2026.03 | 31.68 | 31.05 | |
| Nova Pro v1Model source=Closed-Source, Prompting strategy=6-Shot2026.03 | 31.16 | 29.21 | |
| Gemma 3 12b itModel source=Open-Source, Prompting strategy=6-Shot2026.03 | 28.97 | 26.62 | |
| Gemini 3 ProModel source=Closed-Source, Prompting strategy=Zero-Shot2026.03 | 28.6 | 25.52 | |
| Claude Opus 4.1Model source=Closed-Source, Prompting strategy=Zero-Shot2026.03 | 25.75 | 24.34 | |
| Gemma 3 27b itModel source=Open-Source, Prompting strategy=6-Shot2026.03 | 25.25 | 24.5 | |
| Gemma 3 12b itModel source=Open-Source, Prompting strategy=Zero-Shot2026.03 | 21.79 | 19.08 | |
| Gemma 3 27b itModel source=Open-Source, Prompting strategy=Zero-Shot2026.03 | 19.22 | 17.21 | |
| Gemma 3 4b itModel source=Open-Source, Prompting strategy=6-Shot2026.03 | 18.27 | 15.62 | |
| Gemma 3 4b itModel source=Open-Source, Prompting strategy=Zero-Shot2026.03 | 15.46 | 13.87 |