Clinical Report Generation on S0002 with clinical context, Unimodal + Text Only (test)
0.1912BLEU-1Qwen3-4b-instruct-2507
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Qwen3-4b-instruct-2507Input Setting=Unimodal + Text Only2026.01 | 0.1912 | 0.0218 | 0.269 | 0.0398 | 0.1317 | 0.135 | 0.7867 | 0.1622 | |
| Llama-3.2-3b-instructInput Setting=Unimodal + Text Only2026.01 | 0.1651 | 0.0186 | 0.2346 | 0.0321 | 0.1221 | 0.1271 | 0.7261 | 0.143 | |
| Llama-3.1-8b-instructInput Setting=Unimodal + Text Only2026.01 | 0.1629 | 0.019 | 0.2655 | 0.0424 | 0.1368 | 0.1404 | 0.7502 | 0.148 | |
| Gemma-3-4b-itInput Setting=Unimodal + Text Only2026.01 | 0.1538 | 0.0163 | 0.2775 | 0.0354 | 0.1407 | 0.144 | 0.7851 | 0.1506 | |
| Gemma-3-1b-itInput Setting=Unimodal + Text Only2026.01 | 0.1509 | 0.0158 | 0.233 | 0.0302 | 0.1233 | 0.1259 | 0.7058 | 0.1319 | |
| Meta-llama-3-8b-instructInput Setting=Unimodal + Text Only2026.01 | 0.1441 | 0.0176 | 0.2588 | 0.0403 | 0.1354 | 0.139 | 0.7702 | 0.1416 | |
| Gemma-3n-e2b-itInput Setting=Unimodal + Text Only2026.01 | 0.0925 | 0.0115 | 0.2318 | 0.0274 | 0.1224 | 0.1254 | 0.7683 | 0.1181 | |
| Qwen3-1.7bInput Setting=Unimodal + Text Only2026.01 | 0.0886 | 0.0097 | 0.1189 | 0.0142 | 0.0633 | 0.0652 | 0.365 | 0.0735 | |
| Medgemma-4b-itInput Setting=Unimodal + Text Only2026.01 | 0.0865 | 0.0109 | 0.228 | 0.0341 | 0.1315 | 0.1345 | 0.7576 | 0.1198 | |
| Gemma-3n-e4b-itInput Setting=Unimodal + Text Only2026.01 | 0.0539 | 0.0083 | 0.1998 | 0.0281 | 0.1152 | 0.1175 | 0.7635 | 0.0993 | |
| Llama-3.2-1b-instructInput Setting=Unimodal + Text Only2026.01 | 0.034 | 0.0036 | 0.0954 | 0.0082 | 0.0581 | 0.0596 | 0.5139 | 0.0494 |