Medical Question Answering on CV-MedMCQA (test)
0.9999AUROCAU-probe
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AU-probeModel=Qwen2.5-7B-Instruct2026.01 | 0.9999 | 0.1035 | 0.0207 | |
| AU-probeModel=BioMistral-7B2026.01 | 0.9958 | 0.1063 | 0.0388 | |
| AU-probeModel=Bio-Medical-Llama-3-8B2026.01 | 0.9911 | 0.2131 | 0.0848 | |
| AU-probeModel=Llama-3.1-8B-Instruct2026.01 | 0.969 | 0.0984 | 0.0794 | |
| ASK4CONFModel=Qwen2.5-7B-Instruct2026.01 | 0.719 | 0.1837 | 0.254 | |
| ASK4CONFModel=Llama-3.1-8B-Instruct2026.01 | 0.6011 | 0.3665 | 0.3788 | |
| MSPModel=Bio-Medical-Llama-3-8B2026.01 | 0.5833 | 0.4297 | 0.4331 | |
| Mean Token EntropyModel=Bio-Medical-Llama-3-8B2026.01 | 0.5645 | 0.1814 | 0.2876 | |
| ASK4CONFModel=Bio-Medical-Llama-3-8B2026.01 | 0.5582 | 0.3845 | 0.3942 | |
| Semantic EntropyModel=Llama-3.1-8B-Instruct2026.01 | 0.556 | 0.4245 | 0.426 | |
| RAUQModel=Llama-3.1-8B-Instruct2026.01 | 0.552 | 0.116 | 0.2659 | |
| SARModel=Bio-Medical-Llama-3-8B2026.01 | 0.5441 | 0.0806 | 0.2671 | |
| Mean Token EntropyModel=Qwen2.5-7B-Instruct2026.01 | 0.5421 | 0.2778 | 0.3433 | |
| Semantic EntropyModel=BioMistral-7B2026.01 | 0.5361 | 0.2102 | 0.3074 | |
| SARModel=Qwen2.5-7B-Instruct2026.01 | 0.5316 | 0.3164 | 0.3669 | |
| Semantic EntropyModel=Bio-Medical-Llama-3-8B2026.01 | 0.5308 | 0.2314 | 0.3117 | |
| MSPModel=Qwen2.5-7B-Instruct2026.01 | 0.5303 | 0.4816 | 0.48 | |
| MSPModel=Llama-3.1-8B-Instruct2026.01 | 0.5292 | 0.4797 | 0.4786 | |
| Semantic EntropyModel=Qwen2.5-7B-Instruct2026.01 | 0.5233 | 0.4586 | 0.4594 | |
| RAUQModel=Bio-Medical-Llama-3-8B2026.01 | 0.5168 | 0.1293 | 0.2791 | |
| SARModel=Llama-3.1-8B-Instruct2026.01 | 0.5083 | 0.2005 | 0.3117 | |
| SARModel=BioMistral-7B2026.01 | 0.496 | 0.1195 | 0.2739 | |
| RAUQModel=Qwen2.5-7B-Instruct2026.01 | 0.4938 | 0.2563 | 0.3256 | |
| Mean Token EntropyModel=BioMistral-7B2026.01 | 0.4928 | 0.2599 | 0.331 | |
| Mean Token EntropyModel=Llama-3.1-8B-Instruct2026.01 | 0.49 | 0.269 | 0.3354 | |
| MSPModel=BioMistral-7B2026.01 | 0.4846 | 0.4585 | 0.464 | |
| RAUQModel=BioMistral-7B2026.01 | 0.4844 | 0.1687 | 0.2891 | |
| ASK4CONFModel=BioMistral-7B2026.01 | 0.4356 | 0.3423 | 0.391 |