Medical Question Answering on College Medicine German (test)
78.03AccuracyDeFineMed-Mistral-Small-24B-SLERP
Evaluation results
| Method | Links | |
|---|---|---|
| DeFineMed-Mistral-Small-24B-SLERPEvaluation Setting=one-shot2026.04 | 78.03 | |
| DeFineMed-Mistral-Small-24BEvaluation Setting=one-shot2026.04 | 77.46 | |
| Mistral-Small-24B-InstructEvaluation Setting=one-shot2026.04 | 73.41 | |
| DeFineMed-Qwen2.5-7BEvaluation Setting=one-shot2026.04 | 68.21 | |
| DeFineMed-Qwen2.5-7B-SLERPEvaluation Setting=one-shot2026.04 | 65.9 | |
| Qwen2.5-7B-InstructEvaluation Setting=one-shot2026.04 | 63.01 | |
| DeFineMed-Mistral-7B-SLERPEvaluation Setting=one-shot2026.04 | 56.65 | |
| DeFineMed-Mistral-7BEvaluation Setting=one-shot2026.04 | 55.49 | |
| Mistral-7B-Instruct-v0.3Evaluation Setting=one-shot2026.04 | 53.18 | |
| BioMistral-7B-SLERP (baseline)Evaluation Setting=one-shot2026.04 | 50.87 | |
| BioMistral-7B (baseline)Evaluation Setting=one-shot2026.04 | 40.46 |