Medical Question Answering on Anatomy German (test)
68.89AccuracyDeFineMed-Mistral-Small-24B-SLERP
Evaluation results
| Method | Links | |
|---|---|---|
| DeFineMed-Mistral-Small-24B-SLERPEvaluation Setting=one-shot2026.04 | 68.89 | |
| DeFineMed-Mistral-Small-24BEvaluation Setting=one-shot2026.04 | 68.15 | |
| Mistral-Small-24B-InstructEvaluation Setting=one-shot2026.04 | 66.67 | |
| DeFineMed-Qwen2.5-7B-SLERPEvaluation Setting=one-shot2026.04 | 65.19 | |
| DeFineMed-Qwen2.5-7BEvaluation Setting=one-shot2026.04 | 62.22 | |
| DeFineMed-Mistral-7BEvaluation Setting=one-shot2026.04 | 57.78 | |
| Qwen2.5-7B-InstructEvaluation Setting=one-shot2026.04 | 54.07 | |
| DeFineMed-Mistral-7B-SLERPEvaluation Setting=one-shot2026.04 | 53.33 | |
| BioMistral-7B-SLERP (baseline)Evaluation Setting=one-shot2026.04 | 45.93 | |
| BioMistral-7B (baseline)Evaluation Setting=one-shot2026.04 | 44.44 | |
| Mistral-7B-Instruct-v0.3Evaluation Setting=one-shot2026.04 | 42.22 |