Discharge Summary Generation on MIMIC-IV (test)
10.11ROUGE-1BioMamba
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BioMambaModel size=1.3B, SFT=true2024.08 | 10.11 | 3.69 | 7.04 | |
| BioMamba-1.3B+SFTArchitecture=Mamba2, Params=1.3B, MIMIC-specific supervised fine-tuning=true2024.08 | 10.11 | 3.69 | 7.04 | |
| Mamba2Model size=1.3B, SFT=true2024.08 | 9.99 | 3.7 | 7.04 | |
| BioMambaModel size=130M, SFT=true2024.08 | 9.74 | 3.33 | 6.96 | |
| BioMamba-130M+SFTArchitecture=Mamba2, Params=130M, MIMIC-specific supervised fine-tuning=true2024.08 | 9.74 | 3.33 | 6.96 | |
| BioMambaModel size=370M, SFT=true2024.08 | 9.22 | 3 | 6.39 | |
| BioMambaModel size=780M, SFT=true2024.08 | 9.1 | 2.97 | 6.3 | |
| Mamba2Model size=370M, SFT=true2024.08 | 8.96 | 2.69 | 6.19 | |
| Mamba2Model size=780M, SFT=true2024.08 | 8.86 | 2.73 | 6.14 | |
| Mamba2Model size=130M, SFT=true2024.08 | 8.79 | 2.76 | 6.3 | |
| Meditron3-Gemma2-2BArchitecture=Gemma2, Params=2B, MIMIC-specific supervised fine-tuning=false2024.08 | 6.04 | 0.55 | 3.88 | |
| Bio-Medical-Llama-3.2-1BArchitecture=Llama 3.2, Params=1B, MIMIC-specific supervised fine-tuning=false2024.08 | 5.58 | 0.43 | 3.7 | |
| Gemma3-1B (fine-tuned)Architecture=Gemma3, Params=1B, MIMIC-specific supervised fine-tuning=false2024.08 | 5.55 | 0.42 | 3.77 | |
| Mamba2Model size=1.3B, SFT=false2024.08 | 5.33 | 0.42 | 3.68 | |
| BioGPT-Large-PubMedQAArchitecture=GPT-2, Params=1.5B, MIMIC-specific supervised fine-tuning=false2024.08 | 5.28 | 0.41 | 3.3 | |
| Mamba2Model size=780M, SFT=false2024.08 | 5.22 | 0.37 | 3.59 | |
| Mamba2Model size=130M, SFT=false2024.08 | 4.83 | 0.35 | 3.56 | |
| Mamba2Model size=370M, SFT=false2024.08 | 4.5 | 0.33 | 3.31 | |
| BioGPT-LargeArchitecture=GPT-2, Params=1.5B, MIMIC-specific supervised fine-tuning=false2024.08 | 3.2 | 0.2 | 2.42 | |
| BioMedLMArchitecture=GPT-2, Params=2.7B, MIMIC-specific supervised fine-tuning=false2024.08 | 2.18 | 0.13 | 1.59 | |
| BioGPTArchitecture=GPT-2, Params=347M, MIMIC-specific supervised fine-tuning=false2024.08 | 1.53 | 0.09 | 1.26 |