Medical Question Answering on PubMedQA (Accuracy, 95% CI, Avg. Accuracy)
77.6AccuracyPeer-reviewd reasoning
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Peer-reviewd reasoningModels=(1) + (3) + (4) + (5)2026.06 | 77.6 | 73.8 | 82 | |
| Chain-of-thoughtModel=Llama-3.1-8B2026.06 | 75.4 | 71.6 | 71.1 | |
| Chain-of-thoughtModel=Qwen2.5-7B2026.06 | 67 | 62.8 | 65 | |
| Chain-of-thoughtModel=Deepseek-llm-7b2026.06 | 57 | 52.6 | 43.7 |