Clinical Diagnostic Report Standardization on English Clinical Diagnostic Reports (test)
92.69BLEU-1RetSTA-7B
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| RetSTA-7BModel size category=<10B2025.03 | 92.69 | 89.66 | 86.04 | 90.08 | |
| DeepSeek-V3Model size category=>10B2025.03 | 84.39 | 76.12 | 73.69 | 74.55 | |
| Qwen2.5-72B-InstructModel size category=>10B2025.03 | 80.32 | 66.65 | 66.69 | 57.27 | |
| GLM-4-9BModel size category=<10B2025.03 | 76.4 | 62.18 | 59.76 | 57.46 | |
| Baichuan2-7B-ChatModel size category=<10B2025.03 | 75.49 | 59.79 | 60.57 | 52.55 | |
| Yi-1.5-9B-ChatModel size category=<10B2025.03 | 70.47 | 56.86 | 59.29 | 52.58 | |
| GLM-4-PlusModel size category=>10B2025.03 | 70.44 | 54.53 | 53.46 | 52.52 | |
| OpenBioLLM-8BModel size category=<10B2025.03 | 61.82 | 47.17 | 52.01 | 44.02 | |
| Llama-3.1-8B-InstructModel size category=<10B2025.03 | 53.01 | 43.29 | 53.27 | 43.85 | |
| UltraMedical-8BModel size category=<10B2025.03 | 26.2 | 22.01 | 35.33 | 25.09 | |
| Qwen2.5-7B-InstructModel size category=<10B2025.03 | 20.23 | 16.1 | 18.77 | 16.03 |