Single-turn Dialogue on TriNetX Circulatory
77.75Recall@5DiaLLMs
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DiaLLMs2025.06 | 77.75 | 74.36 | 48.14 | |
| Qwen2.5-7BHead=mlp2025.06 | 68.86 | 55.18 | 45.79 | |
| Mistralv0.3-7BHead=mlp2025.06 | 67.51 | 55.95 | 45.74 | |
| Llama3.1-8BHead=mlp2025.06 | 66.72 | 56.23 | 45.76 | |
| BioMistral2025.06 | 20.01 | 16.62 | 31.08 | |
| Llama3.1-8B2025.06 | 17.02 | 10.89 | 22.97 | |
| Meditron-7B2025.06 | 15.07 | 14.71 | 18.88 | |
| Mistralv0.3-7B2025.06 | 10.98 | 8.67 | 17.57 | |
| Meditron3-8B2025.06 | 10.13 | 16.04 | 19.34 | |
| ChatDoctor2025.06 | 10.03 | 10.03 | 18.34 | |
| Qwen2.5-7B2025.06 | 5.84 | 7.82 | 9.68 |