List your company
ResearchFormerly WizWand

Biomedical Question Answering on PubMedQA PQA-L In-Domain (test)

78AccuracyHuman (expert)
0.72820.78940.8560.911Aug 18, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Human (expert)Setting=Manual2023.0878
BioMedGPT-10BSetting=Fine-tuning2023.0876.1
Llama2-ChatSetting=Fine-tuning2023.0875.5
LlamaSetting=Fine-tuning2023.0873.4
InstructGPTSetting=Zero-shot2023.0873.2
PMC-LlamaSetting=Fine-tuning2023.0869.5
ChatGPTSetting=Zero-shot2023.0863.9
Human (pass)Setting=Manual2023.0860
Llama2-ChatSetting=Zero-shot2023.0821.9
LlamaSetting=Zero-shot2023.085.2
Llama2Setting=Zero-shot2023.083.7