ECG Report Generation on MIMIC-IV-ECG (test)
79.8PrecisionLLaMA-3-Instruct
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LLaMA-3-InstructModel Size=8B, Fine-tuning=True2024.03 | 79.8 | 74.5 | 77.1 | |
| Mistral-InstructModel Size=7B, Fine-tuning=True2024.03 | 77.3 | 72.2 | 74.7 | |
| LLaMA-2-InstructModel Size=7B, Fine-tuning=True2024.03 | 76.4 | 72.5 | 74.4 | |
| MistralModel Size=7B, Fine-tuning=True2024.03 | 76.1 | 73.2 | 74.6 | |
| LLaMA-1Model Size=7B, Fine-tuning=True2024.03 | 75.2 | 69.7 | 72.3 | |
| BLOOMModel Size=7B, Fine-tuning=True2024.03 | 73.4 | 68.4 | 70.8 | |
| GPT-JModel Size=6B, Fine-tuning=True2024.03 | 72.5 | 65.5 | 68.8 | |
| GPT-NeoModel Size=2.7B, Fine-tuning=True2024.03 | 72.3 | 63.3 | 67.5 | |
| GPT-NeoXModel Size=20B, Fine-tuning=True2024.03 | 71.9 | 63.8 | 67.6 | |
| OPTModel Size=6.7B, Fine-tuning=True2024.03 | 71.3 | 66.7 | 68.9 | |
| GPT2-LargeModel Size=774M, Fine-tuning=True2024.03 | 65.7 | 57.4 | 61.3 | |
| GPT2-MediumModel Size=345M, Fine-tuning=True2024.03 | 56.2 | 45.3 | 50.2 |