Note Completion on MIMIC-IV (test)
8.11ROUGE-1BioMamba
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BioMambaModel size=1.3B, SFT=true2024.08 | 8.11 | 3.33 | 5.89 | |
| BioMamba-1.3B+SFTArchitecture=Mamba2, Params=1.3B, MIMIC-specific supervised fine-tuning=true2024.08 | 8.11 | 3.33 | 5.89 | |
| BioMambaModel size=370M, SFT=true2024.08 | 7.94 | 3.2 | 5.69 | |
| Mamba2Model size=1.3B, SFT=true2024.08 | 7.93 | 3.28 | 5.76 | |
| Mamba2Model size=780M, SFT=true2024.08 | 7.9 | 3.24 | 5.73 | |
| BioMambaModel size=780M, SFT=true2024.08 | 7.9 | 3.32 | 5.78 | |
| Mamba2Model size=370M, SFT=true2024.08 | 7.85 | 3.04 | 5.62 | |
| BioMambaModel size=130M, SFT=true2024.08 | 7.07 | 2.45 | 5.1 | |
| BioMamba-130M+SFTArchitecture=Mamba2, Params=130M, MIMIC-specific supervised fine-tuning=true2024.08 | 7.07 | 2.45 | 5.1 | |
| Mamba2Model size=130M, SFT=true2024.08 | 6.84 | 2.36 | 4.95 | |
| Mamba2Model size=1.3B, SFT=false2024.08 | 5.61 | 1.28 | 3.95 | |
| Mamba2Model size=780M, SFT=false2024.08 | 5.46 | 1.17 | 3.86 | |
| Meditron3-Gemma2-2BArchitecture=Gemma2, Params=2B, MIMIC-specific supervised fine-tuning=false2024.08 | 5.13 | 0.89 | 3.37 | |
| Mamba2Model size=370M, SFT=false2024.08 | 5.04 | 0.97 | 3.69 | |
| Bio-Medical-Llama-3.2-1BArchitecture=Llama 3.2, Params=1B, MIMIC-specific supervised fine-tuning=false2024.08 | 4.8 | 0.82 | 3.19 | |
| BioGPT-Large-PubMedQAArchitecture=GPT-2, Params=1.5B, MIMIC-specific supervised fine-tuning=false2024.08 | 4.75 | 0.75 | 3.04 | |
| Mamba2Model size=130M, SFT=false2024.08 | 4.63 | 0.8 | 3.43 | |
| Gemma3-1B (fine-tuned)Architecture=Gemma3, Params=1B, MIMIC-specific supervised fine-tuning=false2024.08 | 4.18 | 0.65 | 2.83 | |
| BioGPT-LargeArchitecture=GPT-2, Params=1.5B, MIMIC-specific supervised fine-tuning=false2024.08 | 3.85 | 0.54 | 2.81 | |
| BioMedLMArchitecture=GPT-2, Params=2.7B, MIMIC-specific supervised fine-tuning=false2024.08 | 1.58 | 0.16 | 1.17 | |
| BioGPTArchitecture=GPT-2, Params=347M, MIMIC-specific supervised fine-tuning=false2024.08 | 1.2 | 0.16 | 1.01 |