# Consultation Capability Evaluation on RAPID-IPN

Source: [Consultation Capability Evaluation on RAPID-IPN](<https://www.sota2.com/research/sota/consultation-capability-evaluation-on-rapid-ipn>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-13T08:19:49.289Z

Evaluation of model performance on the RAPID-IPN dataset, assessing consultation capabilities across dimensions such as conversation arrangement, professional jargon usage, amiable behavior, and response structure (turns).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Consultation Capability Evaluation |
| Dataset (including any stated split) | RAPID-IPN |
| Metric | Conversation Arrangement |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 19 of 19 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Conversation Arrangement](<https://www.sota2.com/research/sota/consultation-capability-evaluation-on-rapid-ipn.md?metric=Conversation%20Arrangement>): Higher is better; unit: SCALAR.

- [Question Types Score](<https://www.sota2.com/research/sota/consultation-capability-evaluation-on-rapid-ipn.md?metric=Question%20Types%20Score>): Higher is better; unit: SCALAR.

- [Verification Score](<https://www.sota2.com/research/sota/consultation-capability-evaluation-on-rapid-ipn.md?metric=Verification%20Score>): Higher is better; unit: SCALAR.

- [Professional Jargon Usage](<https://www.sota2.com/research/sota/consultation-capability-evaluation-on-rapid-ipn.md?metric=Professional%20Jargon%20Usage>): Higher is better; unit: SCALAR.

- [Speech Quality](<https://www.sota2.com/research/sota/consultation-capability-evaluation-on-rapid-ipn.md?metric=Speech%20Quality>): Higher is better; unit: SCALAR.

- [Amiable Behavior](<https://www.sota2.com/research/sota/consultation-capability-evaluation-on-rapid-ipn.md?metric=Amiable%20Behavior>): Higher is better; unit: SCALAR.

- [Response Turns Count](<https://www.sota2.com/research/sota/consultation-capability-evaluation-on-rapid-ipn.md?metric=Response%20Turns%20Count>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Conversation Arrangement | Result date | Report paper |
| --- | --- | --- | --- |
| MiniMax-M2 | 4.04 | Not recorded | 69dc785a7d0172140ec788be |
| Aegle | 4.03 | Not recorded | 69dc785a7d0172140ec788be |
| DeepSeek-V3.2 | 4.02 | Not recorded | 69dc785a7d0172140ec788be |
| Kimi K2 Thinking | 4.01 | Not recorded | 69dc785a7d0172140ec788be |
| Qwen3-Max | 4.01 | Not recorded | 69dc785a7d0172140ec788be |
| HuatuoGPT-o1-7B | 4 | Not recorded | 69dc785a7d0172140ec788be |
| Qwen3-8B-think | 4 | Not recorded | 69dc785a7d0172140ec788be |
| Baichuan-M2-32B | 4 | Not recorded | 69dc785a7d0172140ec788be |
| Lingshu-32B | 4 | Not recorded | 69dc785a7d0172140ec788be |
| DeepSeek-V3.2-Thinking | 4 | Not recorded | 69dc785a7d0172140ec788be |
| GLM-4.6 | 4 | Not recorded | 69dc785a7d0172140ec788be |
| GPT-4o | 4 | Not recorded | 69dc785a7d0172140ec788be |
| Doubao-Seed-1.6 | 4 | Not recorded | 69dc785a7d0172140ec788be |
| ERNIE-5.0-Preview | 4 | Not recorded | 69dc785a7d0172140ec788be |
| CoT | 4 | Not recorded | 69dc785a7d0172140ec788be |
| ToT | 4 | Not recorded | 69dc785a7d0172140ec788be |
| MDAgents | 4 | Not recorded | 69dc785a7d0172140ec788be |
| MedAgents | 4 | Not recorded | 69dc785a7d0172140ec788be |
| Gemini 2.5 | 3.95 | Not recorded | 69dc785a7d0172140ec788be |

### MiniMax-M2

Conversation Arrangement: 4.04. Result ID: 69dca5eb47f34ce924c38475.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Open-source":"true"}. This record does not assert independent reproduction.

### Aegle

Conversation Arrangement: 4.03. Result ID: 69dca5eb47f34ce924c3847f.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Base Model":"DeepSeek-V3.2"}. This record does not assert independent reproduction.

### DeepSeek-V3.2

Conversation Arrangement: 4.02. Result ID: 69dca5eb47f34ce924c38471.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

[Method origin paper](<https://www.sota2.com/research/paper/692fc410d6b0dd33429332f4.md>)

Recorded evaluation configuration: {"Open-source":"true"}. This record does not assert independent reproduction.

### Kimi K2 Thinking

Conversation Arrangement: 4.01. Result ID: 69dca5eb47f34ce924c38474.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Open-source":"true"}. This record does not assert independent reproduction.

### Qwen3-Max

Conversation Arrangement: 4.01. Result ID: 69dca5eb47f34ce924c38478.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Proprietary":"true"}. This record does not assert independent reproduction.

### HuatuoGPT-o1-7B

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c3846d.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Open-source":"true","Medical-domain":"true"}. This record does not assert independent reproduction.

### Qwen3-8B-think

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c3846e.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Open-source":"true"}. This record does not assert independent reproduction.

### Baichuan-M2-32B

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c3846f.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Open-source":"true","Medical-domain":"true"}. This record does not assert independent reproduction.

### Lingshu-32B

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c38470.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Open-source":"true","Medical-domain":"true"}. This record does not assert independent reproduction.

### DeepSeek-V3.2-Thinking

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c38472.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

[Method origin paper](<https://www.sota2.com/research/paper/692fc410d6b0dd33429332f4.md>)

Recorded evaluation configuration: {"Open-source":"true"}. This record does not assert independent reproduction.

### GLM-4.6

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c38473.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Open-source":"true"}. This record does not assert independent reproduction.

### GPT-4o

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c38476.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Proprietary":"true"}. This record does not assert independent reproduction.

### Doubao-Seed-1.6

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c38479.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Proprietary":"true"}. This record does not assert independent reproduction.

### ERNIE-5.0-Preview

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c3847a.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Proprietary":"true"}. This record does not assert independent reproduction.

### CoT

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c3847b.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Base Model":"DeepSeek-V3.2"}. This record does not assert independent reproduction.

### ToT

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c3847c.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71551e209131cea50930.md>)

[Implementation](<https://github.com/princeton-nlp/tree-of-thought-llm>)

Recorded evaluation configuration: {"Base Model":"DeepSeek-V3.2"}. This record does not assert independent reproduction.

### MDAgents

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c3847d.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75761e209131cea6818c.md>)

[Implementation](<https://github.com/mitmedialab/MDAgents>)

Recorded evaluation configuration: {"Base Model":"DeepSeek-V3.2"}. This record does not assert independent reproduction.

### MedAgents

Conversation Arrangement: 4. Result ID: 69dca5eb47f34ce924c3847e.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73701e209131cea5c7d9.md>)

[Implementation](<https://github.com/gersteinlab/MedAgents>)

Recorded evaluation configuration: {"Base Model":"DeepSeek-V3.2"}. This record does not assert independent reproduction.

### Gemini 2.5

Conversation Arrangement: 3.95. Result ID: 69dca5eb47f34ce924c38477.

[Reporting paper](<https://www.sota2.com/research/paper/69dc785a7d0172140ec788be.md>)

Recorded evaluation configuration: {"Proprietary":"true"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
