Medical Question Answering on Multilingual Medical Evaluation Spanish (test)
4.4ECEBioMedGPT-LM-7B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| BioMedGPT-LM-7BParameters=7B2024.02 | 4.4 | 12.3 | |
| MedAlpaca 7BParameters=7B2024.02 | 4.7 | 12 | |
| MediTron-7BParameters=7B2024.02 | 8.2 | 8.5 | |
| PMC-LLAMA 7BParameters=7B2024.02 | 12.9 | 3.8 | |
| BioMistral 7BParameters=7B2024.02 | 14 | 2.7 | |
| BioMistral 7B SLERPMerging Strategy=SLERP2024.02 | 15.4 | 1.3 | |
| BioMistral 7B DAREMerging Strategy=DARE2024.02 | 16.5 | 0.2 | |
| Mistral 7B InstructParameters=7B2024.02 | 16.7 | — | |
| BioMistral 7B TIESMerging Strategy=TIES2024.02 | 16.7 | 0 |