Clinical Drug Recommendation on HPH (real-world unstructured cohort)
80.84F1 Score (%)PACE-RAG
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PACE-RAGBackbone=Qwen3-8B2026.03 | 80.84 | 82.75 | 83.78 | 81.9 | |
| PACE-RAGBackbone=Llama3.1-8B-Instruct2026.03 | 76.3 | 78.44 | 76.69 | 80.41 | |
| Zero-shot BaselineBackbone=Qwen3-8B2026.03 | 75.57 | 75.78 | 80.95 | 75.51 | |
| TreatRAGBackbone=Qwen3-8B2026.03 | 74.86 | 76.29 | 72.42 | 84.69 | |
| MedReflectBackbone=Qwen3-8B2026.03 | 73.11 | 75.15 | 71.62 | 81.27 | |
| Guideline RAGBackbone=Qwen3-8B2026.03 | 69.67 | 67.03 | 78.26 | 68.28 | |
| MedReflectBackbone=Llama3.1-8B-Instruct2026.03 | 62.67 | 66.76 | 61.04 | 71.18 | |
| TreatRAGBackbone=Llama3.1-8B-Instruct2026.03 | 56.62 | 57.94 | 46.79 | 86.22 | |
| Guideline RAGBackbone=Llama3.1-8B-Instruct2026.03 | 50.6 | 54.23 | 45.31 | 65.64 | |
| Zero-shot BaselineBackbone=Llama3.1-8B-Instruct2026.03 | 49.96 | 53.63 | 47.02 | 60.89 |