Medical Active Reasoning on iCraft-MD
73.6Exact AccuracyBALAR
Evaluation results
| Method | Links | |
|---|---|---|
| BALARLLM Backbone=Qwen2.5-32B-Instruct, Max ask rounds=252026.05 | 73.6 | |
| BALARLLM Backbone=Llama-3.1-8B-Instruct, Max ask rounds=252026.05 | 57.1 | |
| MediQ ExpertLLM Backbone=Qwen2.5-32B-Instruct, Max ask rounds=252026.05 | 56.4 | |
| Zero-ShotLLM Backbone=Qwen2.5-32B-Instruct, Max ask rounds=252026.05 | 55 | |
| MediQ ExpertLLM Backbone=Llama-3.1-8B-Instruct, Max ask rounds=252026.05 | 47.1 | |
| Zero-ShotLLM Backbone=Llama-3.1-8B-Instruct, Max ask rounds=252026.05 | 37.9 |