Multiple-choice Question Answering on Cardiology Examination Mod
81.71AccuracyClaude 3.5 Sonnet
Evaluation results
| Method | Links | |
|---|---|---|
| Claude 3.5 Sonnetsetting=zero-shot2025.03 | 81.71 | |
| Gemini 2.0 Prosetting=zero-shot2025.03 | 81.1 | |
| GPT-4osetting=zero-shot2025.03 | 80.49 | |
| Gemini 2.0 Flashsetting=zero-shot2025.03 | 71.34 | |
| Gemini 1.5 Prosetting=zero-shot2025.03 | 67.68 | |
| Gemini 1.5 Flashsetting=zero-shot2025.03 | 59.15 |