Multiple Choice Question Answering on MedQA USMLE
9.4Exclusive Catch Rate (@10%)QWEN 2.5 7B-I
Evaluation results
| Method | Links | ||
|---|---|---|---|
| QWEN 2.5 7B-IProbe training=WikiText, Decoding=Greedy, Prompt=Minimal task prompt, Task-specific training=None2026.04 | 9.4 | 13.4 | |
| Mistral 7B-IProbe training=WikiText, Decoding=Greedy, Prompt=Minimal task prompt, Task-specific training=None2026.04 | 6.5 | 11.2 | |
| Phi-3 Mini-IProbe training=WikiText, Decoding=Greedy, Prompt=Minimal task prompt, Task-specific training=None2026.04 | 1 | 4.1 |