# Clinical Reasoning on AgentClinic\_T offline (test) Source: [Clinical Reasoning on AgentClinic\_T offline (test)]() Collection index: [llms.txt]() Data updated: 2026-06-09T10:47:04.337Z Evaluation of model performance on the Clinical Reasoning task using the test split of the AgentClinic\_T offline dataset, measured by Accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Clinical Reasoning | | Dataset (including any stated split) | AgentClinic\_T offline (test) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 38 of 38 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | SkeMex | 68.22 | Not recorded | 6a279e5e90966ade919bfa97 | | GM | 66.36 | Not recorded | 6a279e5e90966ade919bfa97 | | Evolver | 65.89 | Not recorded | 6a279e5e90966ade919bfa97 | | SkeMex | 65.89 | Not recorded | 6a279e5e90966ade919bfa97 | | SkillWeaver | 65.42 | Not recorded | 6a279e5e90966ade919bfa97 | | Agent KB | 65.42 | Not recorded | 6a279e5e90966ade919bfa97 | | MobileE | 65.42 | Not recorded | 6a279e5e90966ade919bfa97 | | DILU | 64.95 | Not recorded | 6a279e5e90966ade919bfa97 | | DC | 64.49 | Not recorded | 6a279e5e90966ade919bfa97 | | ExPeL | 64.49 | Not recorded | 6a279e5e90966ade919bfa97 | | CFM | 64.02 | Not recorded | 6a279e5e90966ade919bfa97 | | Voyager | 64.02 | Not recorded | 6a279e5e90966ade919bfa97 | | DILU | 64.02 | Not recorded | 6a279e5e90966ade919bfa97 | | AWM | 64.02 | Not recorded | 6a279e5e90966ade919bfa97 | | Agent KB | 64.02 | Not recorded | 6a279e5e90966ade919bfa97 | | MobileE | 64.02 | Not recorded | 6a279e5e90966ade919bfa97 | | CRITIC | 63.55 | Not recorded | 6a279e5e90966ade919bfa97 | | AWM | 63.55 | Not recorded | 6a279e5e90966ade919bfa97 | | Evolver | 63.55 | Not recorded | 6a279e5e90966ade919bfa97 | | GM | 63.08 | Not recorded | 6a279e5e90966ade919bfa97 | | Memp | 63.08 | Not recorded | 6a279e5e90966ade919bfa97 | | SkillWeaver | 63.08 | Not recorded | 6a279e5e90966ade919bfa97 | | Memp | 62.15 | Not recorded | 6a279e5e90966ade919bfa97 | | Reflexion | 62.15 | Not recorded | 6a279e5e90966ade919bfa97 | | CRITIC | 61.21 | Not recorded | 6a279e5e90966ade919bfa97 | | CFM | 60.75 | Not recorded | 6a279e5e90966ade919bfa97 | | Reflexion | 60.28 | Not recorded | 6a279e5e90966ade919bfa97 | | Voyager | 59.81 | Not recorded | 6a279e5e90966ade919bfa97 | | ExPeL | 57.94 | Not recorded | 6a279e5e90966ade919bfa97 | | DC | 55.14 | Not recorded | 6a279e5e90966ade919bfa97 | | ReAct | 34.58 | Not recorded | 6a279e5e90966ade919bfa97 | | ReAct | 34.11 | Not recorded | 6a279e5e90966ade919bfa97 | | GSEM | 29.91 | Not recorded | 6a279e5e90966ade919bfa97 | | CoT | 26.64 | Not recorded | 6a279e5e90966ade919bfa97 | | CoT | 26.17 | Not recorded | 6a279e5e90966ade919bfa97 | | CoT | 22.9 | Not recorded | 6a279e5e90966ade919bfa97 | | GSEM | 21.03 | Not recorded | 6a279e5e90966ade919bfa97 | | CoT | 13.55 | Not recorded | 6a279e5e90966ade919bfa97 | ### SkeMex Accuracy: 68.22. Result ID: 6a27ef25fbc373592c25869e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### GM Accuracy: 66.36. Result ID: 6a27ef25fbc373592c258694. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### Evolver Accuracy: 65.89. Result ID: 6a27ef25fbc373592c258699. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### SkeMex Accuracy: 65.89. Result ID: 6a27ef25fbc373592c2586af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### SkillWeaver Accuracy: 65.42. Result ID: 6a27ef25fbc373592c258696. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### Agent KB Accuracy: 65.42. Result ID: 6a27ef25fbc373592c258698. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### MobileE Accuracy: 65.42. Result ID: 6a27ef25fbc373592c25869b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### DILU Accuracy: 64.95. Result ID: 6a27ef25fbc373592c258692. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### DC Accuracy: 64.49. Result ID: 6a27ef25fbc373592c25869a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### ExPeL Accuracy: 64.49. Result ID: 6a27ef25fbc373592c2586a4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### CFM Accuracy: 64.02. Result ID: 6a27ef25fbc373592c25869c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### Voyager Accuracy: 64.02. Result ID: 6a27ef25fbc373592c2586a2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### DILU Accuracy: 64.02. Result ID: 6a27ef25fbc373592c2586a3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### AWM Accuracy: 64.02. Result ID: 6a27ef25fbc373592c2586a8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### Agent KB Accuracy: 64.02. Result ID: 6a27ef25fbc373592c2586a9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### MobileE Accuracy: 64.02. Result ID: 6a27ef25fbc373592c2586ac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### CRITIC Accuracy: 63.55. Result ID: 6a27ef25fbc373592c258690. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### AWM Accuracy: 63.55. Result ID: 6a27ef25fbc373592c258697. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### Evolver Accuracy: 63.55. Result ID: 6a27ef25fbc373592c2586aa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### GM Accuracy: 63.08. Result ID: 6a27ef25fbc373592c2586a5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### Memp Accuracy: 63.08. Result ID: 6a27ef25fbc373592c2586a6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### SkillWeaver Accuracy: 63.08. Result ID: 6a27ef25fbc373592c2586a7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### Memp Accuracy: 62.15. Result ID: 6a27ef25fbc373592c258695. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### Reflexion Accuracy: 62.15. Result ID: 6a27ef25fbc373592c2586a0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### CRITIC Accuracy: 61.21. Result ID: 6a27ef25fbc373592c2586a1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### CFM Accuracy: 60.75. Result ID: 6a27ef25fbc373592c2586ad. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### Reflexion Accuracy: 60.28. Result ID: 6a27ef25fbc373592c25868f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### Voyager Accuracy: 59.81. Result ID: 6a27ef25fbc373592c258691. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### ExPeL Accuracy: 57.94. Result ID: 6a27ef25fbc373592c258693. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### DC Accuracy: 55.14. Result ID: 6a27ef25fbc373592c2586ab. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### ReAct Accuracy: 34.58. Result ID: 6a27ef25fbc373592c25869f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### ReAct Accuracy: 34.11. Result ID: 6a27ef25fbc373592c25868e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### GSEM Accuracy: 29.91. Result ID: 6a27ef25fbc373592c2586ae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3.6-Plus","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### CoT Accuracy: 26.64. Result ID: 6a27ef25fbc373592c25868d. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### CoT Accuracy: 26.17. Result ID: 6a27ef25fbc373592c25868c. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"MedGemma-27B","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### CoT Accuracy: 22.9. Result ID: 6a27ef25fbc373592c25868a. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Hulu-Med-32B","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### GSEM Accuracy: 21.03. Result ID: 6a27ef25fbc373592c25869d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. ### CoT Accuracy: 13.55. Result ID: 6a27ef25fbc373592c25868b. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Lingshu-32B","Evaluation Setting":"Offline"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.