List your company
ResearchFormerly WizWand

Biomedical Question Answering on MedMCQA In-Domain (test)

90AccuracyHuman (expert)
21.67239.41157.1574.889Aug 18, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Human (expert)Setting=Manual2023.0890
BioMedGPT-10BSetting=Fine-tuning2023.0851.4
PMC-LlamaSetting=Fine-tuning2023.0850.5
Llama2-ChatSetting=Fine-tuning2023.0848.3
LlamaSetting=Fine-tuning2023.0848.2
ChatGPTSetting=Zero-shot2023.0844.7
InstructGPTSetting=Zero-shot2023.0844
Llama2-ChatSetting=Zero-shot2023.0835.5
Llama2Setting=Zero-shot2023.0830.6
LlamaSetting=Zero-shot2023.0824.3