Multiple Choice Question Answering on MedQA
50.98AccuracyDS2-INSTRUCT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DS2-INSTRUCTModel Family=Qwen2.52026.03 | 50.98 | — | |
| Self-InstructModel Family=Qwen2.52026.03 | 48.92 | — | |
| Zero-ShotModel Family=Qwen2.52026.03 | 48.35 | — | |
| InstructMixModel Family=Qwen2.52026.03 | 47.83 | — | |
| ExploreInstructModel Family=Qwen2.52026.03 | 47.15 | — | |
| QAPBackbone=Flan-T5, Parameter Count=11B2025.03 | 44.01 | 0.34 | |
| DS2-INSTRUCTModel Family=Mistral2026.03 | 42.99 | — | |
| QAPBackbone=Llama2-chat, Parameter Count=13B2025.03 | 42.56 | 0.34 | |
| PEBackbone=Llama2-chat, Parameter Count=13B2025.03 | 40.83 | 0.1 | |
| QAPBackbone=Llama2-chat, Parameter Count=7B2025.03 | 39.94 | 0.33 | |
| GNPBackbone=Flan-T5, Parameter Count=11B2025.03 | 39.76 | 0.31 | |
| Self-InstructModel Family=Mistral2026.03 | 39.74 | — | |
| PEBackbone=Flan-T5, Parameter Count=11B2025.03 | 39.54 | 0.15 | |
| LLMBackbone=Flan-T5, Parameter Count=11B2025.03 | 39.18 | 0.07 | |
| DS2-INSTRUCTModel Family=Llama32026.03 | 39.15 | — | |
| LLMBackbone=Llama2-chat, Parameter Count=13B2025.03 | 39.06 | 0.14 | |
| SPBackbone=Flan-T5, Parameter Count=11B2025.03 | 38.98 | 0.33 | |
| QAPBackbone=Flan-T5, Parameter Count=3B2025.03 | 38.33 | 0.3 | |
| ExploreInstructModel Family=Mistral2026.03 | 37.92 | — | |
| LLMBackbone=Llama2-chat, Parameter Count=7B2025.03 | 36.78 | 0.17 | |
| PEBackbone=Llama2-chat, Parameter Count=7B2025.03 | 36.33 | 0.17 | |
| KGEPBackbone=Llama2-chat, Parameter Count=7B2025.03 | 35.18 | 0.39 | |
| PEBackbone=Flan-T5, Parameter Count=3B2025.03 | 34.36 | 0.11 | |
| LLMBackbone=Flan-T5, Parameter Count=3B2025.03 | 34.22 | 0.14 | |
| SPBackbone=Flan-T5, Parameter Count=3B2025.03 | 33.98 | 0.49 | |
| KGEPBackbone=Flan-T5, Parameter Count=11B2025.03 | 33.93 | 0.46 | |
| GNPBackbone=Flan-T5, Parameter Count=3B2025.03 | 33.87 | 0.26 | |
| KGEPBackbone=Llama2-chat, Parameter Count=13B2025.03 | 33.37 | 0.29 | |
| InstructMixModel Family=Llama32026.03 | 33.29 | — | |
| GNPBackbone=Llama2-chat, Parameter Count=7B2025.03 | 32.01 | 0.29 | |
| Self-InstructModel Family=Llama32026.03 | 31.58 | — | |
| ExploreInstructModel Family=Llama32026.03 | 30.46 | — | |
| KGEPBackbone=Flan-T5, Parameter Count=3B2025.03 | 30.21 | 0.41 | |
| InstructMixModel Family=Mistral2026.03 | 30.15 | — | |
| SPBackbone=Llama2-chat, Parameter Count=7B2025.03 | 27.82 | 0.28 | |
| Zero-ShotModel Family=Llama32026.03 | 27.38 | — | |
| GNPBackbone=Llama2-chat, Parameter Count=13B2025.03 | 25.01 | 0.28 | |
| SPBackbone=Llama2-chat, Parameter Count=13B2025.03 | 23.94 | 0.22 | |
| Zero-ShotModel Family=Mistral2026.03 | 14.03 | — |