Medical Question Answering on MedQA (Accuracy and Prompting Deltas)
92.8AccuracyOctoToolsbase
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OctoToolsbaseBackbone=gpt-4o-2024-08-06, Modality=Text, Domain=Medical, Visual Understanding=false, Numerical Calculation=false, Knowledge Retrieval=true, Multi-step Reasoning=false2025.02 | 92.8 | — | — | |
| OctoToolsBackbone=gpt-4o-2024-08-06, Modality=Text, Domain=Medical, Visual Understanding=false, Numerical Calculation=false, Knowledge Retrieval=true, Multi-step Reasoning=false2025.02 | 91.5 | 7 | 6.7 | |
| CoTBackbone=gpt-4o-2024-08-06, Modality=Text, Domain=Medical, Visual Understanding=false, Numerical Calculation=false, Knowledge Retrieval=true, Multi-step Reasoning=false2025.02 | 84.8 | — | — | |
| 0-shotBackbone=gpt-4o-2024-08-06, Modality=Text, Domain=Medical, Visual Understanding=false, Numerical Calculation=false, Knowledge Retrieval=true, Multi-step Reasoning=false2025.02 | 84.5 | — | — |