Biomedical Knowledge on MMLU bio
95.6AccuracyOracle
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| OracleType=Single LLM with Routing2026.01 | 95.6 | — | — | |
| Bio-Medical-Llama-3-8BType=Single LLM2026.01 | 87 | — | — | |
| RouteMoAType=Ours2026.01 | 79.3 | 0.21 | 9.51 | |
| Gemma-2-9B-itType=Single LLM2026.01 | 78.6 | — | — | |
| MoAType=Multi-LLMs2026.01 | 76 | 1.78 | 14.07 | |
| SMoAType=Multi-LLMs2026.01 | 75.7 | 0.36 | 11.86 | |
| RouterDCType=Single LLM with Routing2026.01 | 70.9 | — | — | |
| Ministral-8B-Instruct-2410Type=Single LLM2026.01 | 70.7 | — | — | |
| Qwen2.5-Coder-7B-InstructType=Single LLM2026.01 | 67.2 | — | — | |
| RouteLLMType=Single LLM with Routing2026.01 | 65.7 | — | — | |
| Qwen2.5-Math-7B-InstructType=Single LLM2026.01 | 43.5 | — | — |