Medical Dialogue Generation on MidMed (test)
0.4059ROUGEInsMed
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| InsMed2023.06 | 0.4059 | — | — | — | 3.3 | 0.2313 | 0.4261 | 0.2846 | 0.23 | 0.1973 | 0.3645 | |
| InsMedtopic instructions=removed2023.06 | 0.3499 | — | — | — | 3.17 | 0.2241 | 0.4203 | 0.2797 | 0.226 | 0.1926 | 0.3526 | |
| InsMedknowledge instructions=removed2023.06 | 0.3222 | — | — | — | 3.14 | 0.2219 | 0.4113 | 0.2721 | 0.2212 | 0.1891 | 0.348 | |
| BART2023.06 | 0.3163 | — | — | — | 3.12 | 0.2195 | 0.4136 | 0.2726 | 0.2204 | 0.1887 | 0.3474 | |
| VRbot2023.06 | 0.2301 | — | — | — | 1.41 | 0.0484 | 0.2267 | 0.0807 | 0.0355 | 0.0131 | 0.1866 | |
| DialoGPT2023.06 | 0.1958 | — | — | — | 1.14 | 0.0462 | 0.1764 | 0.0597 | 0.0284 | 0.0153 | 0.1736 | |
| MGCG2023.06 | 0.1437 | — | — | — | 0.98 | 0.0336 | 0.1588 | 0.0539 | 0.0261 | 0.0106 | 0.1524 | |
| BST2023.06 | 0.1364 | — | — | — | 0.81 | 0.0288 | 0.1401 | 0.0489 | 0.0215 | 0.0102 | 0.1381 | |
| Seq2Seq2023.06 | 0.1221 | — | — | — | 0.77 | 0.0293 | 0.1425 | 0.0492 | 0.0208 | 0.0101 | 0.1366 | |
| BART2023.06 | — | 1.32 | 1.3 | 1.68 | — | — | — | — | — | — | — | |
| BST2023.06 | — | 0.33 | 0.29 | 0.37 | — | — | — | — | — | — | — | |
| DialoGPT2023.06 | — | 0.5 | 0.46 | 0.7 | — | — | — | — | — | — | — | |
| Groundtruth2023.06 | — | 1.98 | 2 | 2 | — | — | — | — | — | — | — | |
| InsMed2023.06 | — | 1.42 | 1.54 | 1.88 | — | — | — | — | — | — | — | |
| MGCG2023.06 | — | 0.39 | 0.31 | 0.41 | — | — | — | — | — | — | — | |
| Seq2Seq2023.06 | — | 0.27 | 0.24 | 0.32 | — | — | — | — | — | — | — | |
| VRbot2023.06 | — | 0.42 | 0.36 | 0.48 | — | — | — | — | — | — | — |