Medical Diagnosis on AgentClinic OOD original (test)
0.684Similarity (Sim)Aloe-Beta-70B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Aloe-Beta-70BModel category=Medical open-source2026.05 | 0.684 | 39.5 | 39.5 | |
| Aloe-Beta-70BModel / Variant=Aloe-Beta-70B2026.05 | 0.684 | 39.5 | 39.5 | |
| MedExAgent-8BModel category=Medical open-source2026.05 | 0.672 | 37.8 | 37.8 | |
| MedExAgent-8BVariant=full2026.05 | 0.672 | 37.8 | 37.8 | |
| MedExAgent-8BVariant=w/o noise injection2026.05 | 0.669 | 31.8 | 31.8 | |
| MedExAgent-8BVariant=w/o tool-match reward2026.05 | 0.653 | 26.6 | 26.9 | |
| Qwen3-32BModel category=General open-source2026.05 | 0.637 | 31 | 36.8 | |
| Qwen2-32BModel / Variant=Qwen2-32B2026.05 | 0.637 | 31 | 36.8 | |
| HuatuoGPT-o1-70BModel category=Medical open-source, thinking mode=on2026.05 | 0.625 | 23.8 | 24.9 | |
| HuatuoGPT-o1-70BModel / Variant=HuatuoGPT-o1-70B2026.05 | 0.625 | 23.8 | 24.9 | |
| Qwen3-14BModel category=General open-source2026.05 | 0.614 | 22.6 | 28.4 | |
| Qwen2-14BModel / Variant=Qwen2-14B2026.05 | 0.614 | 22.6 | 28.4 | |
| MedExAgent-8BVariant=SFT-only2026.05 | 0.589 | 28.6 | 28.9 | |
| Llama-3.1-8B-InstructModel category=General open-source2026.05 | 0.575 | 22.5 | 29.8 | |
| Llama-3.1-8B-InstructModel / Variant=Llama-3.1-8B-Instruct2026.05 | 0.575 | 22.5 | 29.8 | |
| Qwen3-8BModel category=General open-source2026.05 | 0.565 | 15.3 | 21.9 | |
| Qwen2-8BModel / Variant=Qwen2-8B2026.05 | 0.565 | 15.3 | 21.9 | |
| MedGemma-27B-text-itModel category=Medical open-source2026.05 | 0.544 | 21.4 | 24.9 | |
| MedGemma-27B-text-itModel / Variant=MedGemma-27B-text-it2026.05 | 0.544 | 21.4 | 24.9 | |
| MedExAgent-8BVariant=w/o cost penalty2026.05 | 0.383 | 26.1 | 26.4 |