Medical Question Answering on CV-MedExQA (test)
0.9987AUROCAU-probe
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AU-probeModel=Qwen2.5-7B-Instruct2026.01 | 0.9987 | 0.2488 | 0.1277 | |
| AU-probeModel=BioMistral-7B2026.01 | 0.978 | 0.2282 | 0.1551 | |
| AU-probeModel=Bio-Medical-Llama-3-8B2026.01 | 0.9553 | 0.2516 | 0.1847 | |
| AU-probeModel=Llama-3.1-8B-Instruct2026.01 | 0.8867 | 0.1839 | 0.1793 | |
| ASK4CONFModel=Qwen2.5-7B-Instruct2026.01 | 0.7056 | 0.2184 | 0.2693 | |
| ASK4CONFModel=Llama-3.1-8B-Instruct2026.01 | 0.6497 | 0.3886 | 0.3872 | |
| MSPModel=BioMistral-7B2026.01 | 0.641 | 0.4644 | 0.4661 | |
| SARModel=BioMistral-7B2026.01 | 0.6349 | 0.0741 | 0.2434 | |
| RAUQModel=BioMistral-7B2026.01 | 0.6274 | 0.1951 | 0.2778 | |
| Semantic EntropyModel=BioMistral-7B2026.01 | 0.6188 | 0.2168 | 0.2907 | |
| Mean Token EntropyModel=BioMistral-7B2026.01 | 0.5981 | 0.2925 | 0.3301 | |
| MSPModel=Bio-Medical-Llama-3-8B2026.01 | 0.5905 | 0.4268 | 0.4287 | |
| Mean Token EntropyModel=Bio-Medical-Llama-3-8B2026.01 | 0.5812 | 0.1619 | 0.2752 | |
| Semantic EntropyModel=Llama-3.1-8B-Instruct2026.01 | 0.5768 | 0.4369 | 0.4359 | |
| Semantic EntropyModel=Bio-Medical-Llama-3-8B2026.01 | 0.5611 | 0.2657 | 0.3206 | |
| RAUQModel=Llama-3.1-8B-Instruct2026.01 | 0.56 | 0.2246 | 0.3014 | |
| SARModel=Bio-Medical-Llama-3-8B2026.01 | 0.5572 | 0.0949 | 0.2613 | |
| ASK4CONFModel=Bio-Medical-Llama-3-8B2026.01 | 0.5546 | 0.3905 | 0.4 | |
| MSPModel=Llama-3.1-8B-Instruct2026.01 | 0.5514 | 0.4752 | 0.4737 | |
| Mean Token EntropyModel=Llama-3.1-8B-Instruct2026.01 | 0.5401 | 0.3317 | 0.3612 | |
| SARModel=Qwen2.5-7B-Instruct2026.01 | 0.5376 | 0.3422 | 0.3819 | |
| RAUQModel=Bio-Medical-Llama-3-8B2026.01 | 0.5371 | 0.1385 | 0.2763 | |
| SARModel=Llama-3.1-8B-Instruct2026.01 | 0.5364 | 0.215 | 0.311 | |
| Semantic EntropyModel=Qwen2.5-7B-Instruct2026.01 | 0.5305 | 0.4395 | 0.4452 | |
| MSPModel=Qwen2.5-7B-Instruct2026.01 | 0.5299 | 0.4276 | 0.4359 | |
| Mean Token EntropyModel=Qwen2.5-7B-Instruct2026.01 | 0.5215 | 0.2902 | 0.3542 | |
| RAUQModel=Qwen2.5-7B-Instruct2026.01 | 0.5111 | 0.2455 | 0.3147 | |
| ASK4CONFModel=BioMistral-7B2026.01 | 0.5051 | 0.3365 | 0.3712 |