Medical Diagnosis on DDXPlus n=50
78Top-1 AccuracyBMBE + GPT-5.4-nano
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BMBE + GPT-5.4-nanoSystem Category=BMBE + sensor LLM, Sensor LLM=GPT-5.4-nano, Abstention Mechanism=DHS-optimal τ*2026.04 | 78 | 90 | 81 | 96 | 88 | |
| BMBE + Gemini 3.1 Flash LiteSystem Category=BMBE + sensor LLM, Sensor LLM=Gemini 3.1 Flash Lite, Abstention Mechanism=DHS-optimal τ*2026.04 | 74 | 90 | 77 | 96 | 86 | |
| BMBE + GPT-OSS-20BSystem Category=BMBE + sensor LLM, Sensor LLM=GPT-OSS-20B, Abstention Mechanism=DHS-optimal τ*2026.04 | 61 | 78 | 70 | 88 | 78 | |
| SA GPT-5.4System Category=Standalone LLM doctors (frontier), Abstention Mechanism=self-determine abstention2026.04 | 60 | 84 | 64 | 78 | 70 | |
| SA Gemini 3.1 ProSystem Category=Standalone LLM doctors (frontier), Abstention Mechanism=self-determine abstention2026.04 | 60 | 64 | 63 | 96 | 76 | |
| BMBE + MiniMax M2.5System Category=BMBE + sensor LLM, Sensor LLM=MiniMax M2.5, Abstention Mechanism=DHS-optimal τ*2026.04 | 60 | 78 | 64 | 94 | 76 | |
| BMBE + Gemma 4 31BSystem Category=BMBE + sensor LLM, Sensor LLM=Gemma 4 31B, Abstention Mechanism=DHS-optimal τ*2026.04 | 58 | 78 | 60 | 96 | 74 | |
| SA Llama-4-MaverickSystem Category=Standalone LLM doctors (frontier), Abstention Mechanism=self-determine abstention2026.04 | 56 | 72 | 57 | 92 | 70 | |
| BMBE + Llama-4-ScoutSystem Category=BMBE + sensor LLM, Sensor LLM=Llama-4-Scout, Abstention Mechanism=DHS-optimal τ*2026.04 | 56 | 70 | 61 | 92 | 73 | |
| SA Qwen 3.6 PlusSystem Category=Standalone LLM doctors (frontier), Abstention Mechanism=self-determine abstention2026.04 | 48 | 72 | 51 | 94 | 66 | |
| SA Kimi K2.5System Category=Standalone LLM doctors (frontier), Abstention Mechanism=self-determine abstention2026.04 | 42 | 58 | 54 | 74 | 63 | |
| SA GPT-OSS-120BSystem Category=Standalone LLM doctors (frontier), Abstention Mechanism=self-determine abstention2026.04 | 40 | 48 | 41 | 98 | 58 |