Medical Question Answering on Multilingual Medical Evaluation Portuguese (test)
4.3ECEMedAlpaca 7B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MedAlpaca 7BParameters=7B2024.02 | 4.3 | 12.3 | |
| BioMedGPT-LM-7BParameters=7B2024.02 | 5.3 | 11.3 | |
| MediTron-7BParameters=7B2024.02 | 7.2 | 9.4 | |
| PMC-LLAMA 7BParameters=7B2024.02 | 12.2 | 4.4 | |
| BioMistral 7BParameters=7B2024.02 | 15.2 | 1.4 | |
| BioMistral 7B SLERPMerging Strategy=SLERP2024.02 | 15.3 | 1.3 | |
| Mistral 7B InstructParameters=7B2024.02 | 16.6 | — | |
| BioMistral 7B DAREMerging Strategy=DARE2024.02 | 17.2 | -0.6 | |
| BioMistral 7B TIESMerging Strategy=TIES2024.02 | 17.8 | -1.2 |