Medical Question Answering on CV-MedQA ambiguous (test)
0.7643AccuracyAU-Probe
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AU-ProbeModel=Bio-Medical-Llama-3-8B, Clarification Threshold=0.52026.01 | 0.7643 | 15.63 | |
| ASK4CONFModel=Bio-Medical-Llama-3-8B, Clarification Threshold=0.52026.01 | 0.6866 | — | |
| No ClarificationModel=Bio-Medical-Llama-3-8B, Clarification Threshold=N/A2026.01 | 0.608 | — | |
| AU-ProbeModel=Qwen2.5-7B, Clarification Threshold=0.52026.01 | 0.5939 | 10.84 | |
| AU-ProbeModel=Llama-3.1-8B, Clarification Threshold=0.52026.01 | 0.5719 | 9.03 | |
| ASK4CONFModel=Llama-3.1-8B, Clarification Threshold=0.52026.01 | 0.5232 | — | |
| ASK4CONFModel=Qwen2.5-7B, Clarification Threshold=0.52026.01 | 0.5169 | — | |
| No ClarificationModel=Qwen2.5-7B, Clarification Threshold=N/A2026.01 | 0.4855 | — | |
| No ClarificationModel=Llama-3.1-8B, Clarification Threshold=N/A2026.01 | 0.4815 | — | |
| AU-ProbeModel=BioMistral-7B, Clarification Threshold=0.52026.01 | 0.4116 | 4.79 | |
| ASK4CONFModel=BioMistral-7B, Clarification Threshold=0.52026.01 | 0.3841 | — | |
| No ClarificationModel=BioMistral-7B, Clarification Threshold=N/A2026.01 | 0.3637 | — |