Medical Question Answering on Multilingual Medical Evaluation Arabic (test)
5.1ECEBioMedGPT-LM-7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BioMedGPT-LM-7BParameters=7B2024.02 | 5.1 | 11.5 | |
| MedAlpaca 7BParameters=7B2024.02 | 7.8 | 8.8 | |
| MediTron-7BParameters=7B2024.02 | 10.5 | 6.1 | |
| BioMistral 7BParameters=7B2024.02 | 13.9 | 2.7 | |
| BioMistral 7B SLERPMerging Strategy=SLERP2024.02 | 14.8 | 1.8 | |
| PMC-LLAMA 7BParameters=7B2024.02 | 15.1 | 1.5 | |
| BioMistral 7B TIESMerging Strategy=TIES2024.02 | 15.7 | 0.9 | |
| Mistral 7B InstructParameters=7B2024.02 | 16.6 | — | |
| BioMistral 7B DAREMerging Strategy=DARE2024.02 | 16.9 | -0.3 |