Multiple-choice Question Answering on Cardiology Examination Hard
56.85AccuracyGemini 2.0 Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini 2.0 Prosetting=zero-shot2025.03 | 56.85 | |
| Claude 3.5 Sonnetsetting=zero-shot2025.03 | 53.42 | |
| Gemini 1.5 Prosetting=zero-shot2025.03 | 52.74 | |
| Gemini 2.0 Flashsetting=zero-shot2025.03 | 52.74 | |
| GPT-4osetting=zero-shot2025.03 | 50 | |
| Gemini 1.5 Flashsetting=zero-shot2025.03 | 42.47 |