Medical Question Answering on MedQA-de (test)
70.2AccuracyDeFineMed-Mistral-Small-24B-SLERP
Evaluation results
| Method | Links | |
|---|---|---|
| DeFineMed-Mistral-Small-24B-SLERPEvaluation Setting=one-shot2026.04 | 70.2 | |
| Mistral-Small-24B-InstructEvaluation Setting=one-shot2026.04 | 68.8 | |
| DeFineMed-Mistral-Small-24BEvaluation Setting=one-shot2026.04 | 68.8 | |
| DeFineMed-Qwen2.5-7B-SLERPEvaluation Setting=one-shot2026.04 | 54.2 | |
| DeFineMed-Qwen2.5-7BEvaluation Setting=one-shot2026.04 | 52.6 | |
| DeFineMed-Mistral-7B-SLERPEvaluation Setting=one-shot2026.04 | 50.2 | |
| Qwen2.5-7B-InstructEvaluation Setting=one-shot2026.04 | 50.2 | |
| DeFineMed-Mistral-7BEvaluation Setting=one-shot2026.04 | 46.8 | |
| Mistral-7B-Instruct-v0.3Evaluation Setting=one-shot2026.04 | 42.4 | |
| BioMistral-7B-SLERP (baseline)Evaluation Setting=one-shot2026.04 | 37.6 | |
| BioMistral-7B (baseline)Evaluation Setting=one-shot2026.04 | 37.2 |