Medical Question Answering on MedXpertQA Expert 2450
72AccuracyGemini 3.1 Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini 3.1 ProType=Commercial LLMs, Setting=BioMedArena2026.05 | 72 | |
| Claude Opus 4.6Type=Commercial LLMs, Setting=BioMedArena2026.05 | 66 | |
| Gemini 3 FlashType=Commercial LLMs, Setting=BioMedArena2026.05 | 63.6 | |
| Claude Sonnet 4.6Type=Commercial LLMs, Setting=BioMedArena2026.05 | 62.4 | |
| Claude Opus 4.5Type=Commercial LLMs, Setting=BioMedArena2026.05 | 62 | |
| Claude Sonnet 4.5Type=Commercial LLMs, Setting=BioMedArena2026.05 | 60.1 | |
| Gemini 3.1 ProType=Commercial LLMs, Setting=Baseline2026.05 | 58.9 | |
| Claude Opus 4.6Type=Commercial LLMs, Setting=Baseline2026.05 | 55.8 | |
| Gemini 3 FlashType=Commercial LLMs, Setting=Baseline2026.05 | 52.9 | |
| Claude Sonnet 4.6Type=Commercial LLMs, Setting=Baseline2026.05 | 51 | |
| Claude Opus 4.5Type=Commercial LLMs, Setting=Baseline2026.05 | 49.4 | |
| Claude Sonnet 4.5Type=Commercial LLMs, Setting=Baseline2026.05 | 45.9 | |
| SOTASource=[24]2026.05 | 42.8 |