# Professional Consensus Building on MedQA Source: [Professional Consensus Building on MedQA]() Collection index: [llms.txt]() Data updated: 2026-03-27T12:38:26.419Z Evaluation of model performance on the MedQA dataset specifically focusing on Professional Consensus Building, typically measured by accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Professional Consensus Building | | Dataset (including any stated split) | MedQA | | Metric | MedQA Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [MedQA Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | MedQA Accuracy | Result date | Report paper | | --- | --- | --- | --- | | CAMEL | 84.83 | Not recorded | 69c60ef00636e5bf4afc8410 | | BEACOF | 84.67 | Not recorded | 69c60ef00636e5bf4afc8410 | | ReConcile | 73.25 | Not recorded | 69c60ef00636e5bf4afc8410 | | MAD | 71.83 | Not recorded | 69c60ef00636e5bf4afc8410 | | ReConcile | 55.5 | Not recorded | 69c60ef00636e5bf4afc8410 | | BEACOF | 55.5 | Not recorded | 69c60ef00636e5bf4afc8410 | | CAMEL | 54.5 | Not recorded | 69c60ef00636e5bf4afc8410 | | BEACOF | 52.23 | Not recorded | 69c60ef00636e5bf4afc8410 | | CAMEL | 52.17 | Not recorded | 69c60ef00636e5bf4afc8410 | | ReConcile | 44.75 | Not recorded | 69c60ef00636e5bf4afc8410 | | MAD | 34.5 | Not recorded | 69c60ef00636e5bf4afc8410 | | MAD | 31.17 | Not recorded | 69c60ef00636e5bf4afc8410 | ### CAMEL MedQA Accuracy: 84.83. Result ID: 69c6795247f34ce924b04e90. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen3-30B-A3B"}. This record does not assert independent reproduction. ### BEACOF MedQA Accuracy: 84.67. Result ID: 69c6795247f34ce924b04e93. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen3-30B-A3B"}. This record does not assert independent reproduction. ### ReConcile MedQA Accuracy: 73.25. Result ID: 69c6795247f34ce924b04e92. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen3-30B-A3B"}. This record does not assert independent reproduction. ### MAD MedQA Accuracy: 71.83. Result ID: 69c6795247f34ce924b04e91. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen3-30B-A3B"}. This record does not assert independent reproduction. ### ReConcile MedQA Accuracy: 55.5. Result ID: 69c6795247f34ce924b04e8e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Gemma3-12B"}. This record does not assert independent reproduction. ### BEACOF MedQA Accuracy: 55.5. Result ID: 69c6795247f34ce924b04e8f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Gemma3-12B"}. This record does not assert independent reproduction. ### CAMEL MedQA Accuracy: 54.5. Result ID: 69c6795247f34ce924b04e8c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Gemma3-12B"}. This record does not assert independent reproduction. ### BEACOF MedQA Accuracy: 52.23. Result ID: 69c6795247f34ce924b04e8b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama3.1-8B-Instruct"}. This record does not assert independent reproduction. ### CAMEL MedQA Accuracy: 52.17. Result ID: 69c6795247f34ce924b04e88. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama3.1-8B-Instruct"}. This record does not assert independent reproduction. ### ReConcile MedQA Accuracy: 44.75. Result ID: 69c6795247f34ce924b04e8a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama3.1-8B-Instruct"}. This record does not assert independent reproduction. ### MAD MedQA Accuracy: 34.5. Result ID: 69c6795247f34ce924b04e89. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama3.1-8B-Instruct"}. This record does not assert independent reproduction. ### MAD MedQA Accuracy: 31.17. Result ID: 69c6795247f34ce924b04e8d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Gemma3-12B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.