Hospital Course Summarization on MIMIC-III-ext-VeriFact-BHC 120 prompts (test)
10.7Local Verifier NS-rateBase (Llama-3.1)
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Base (Llama-3.1)Backbone=Llama-3.12026.03 | 10.7 | 1.98 | 15 | 11.6 | 2.14 | 12 | 76.7 | 1,855 | |
| SFT Baseline2026.03 | 10.1 | 1.92 | 14.4 | 10 | 2.04 | 12.8 | 64.2 | 1,865 | |
| Verifier RerankReranking Factor (K)=82026.03 | 3.4 | 0.69 | 18.9 | 8.3 | 1.76 | 14.4 | 85 | 1,900 | |
| DPO (VERI-DPO)2026.03 | 1.9 | 0.36 | 19.1 | 6.4 | 1.26 | 14.6 | 82.5 | 2,159 |