Report Generation on MIMIC-CXR-JPG (test)
21.6BLEU-4VILA-M3-13B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| VILA-M3-13BParams=13B, expert_knowledge_inclusion=true2024.11 | 21.6 | 32.1 | 39.3 | |
| VILA-M3-40BParams=40B, expert_knowledge_inclusion=false2024.11 | 21.6 | 32.2 | 39.2 | |
| VILA-M3-40BParams=40B, expert_knowledge_inclusion=true2024.11 | 21.6 | 32.2 | 39.2 | |
| VILA-M3-8BParams=8B, expert_knowledge_inclusion=false2024.11 | 21.4 | 32.2 | 39.8 | |
| VILA-M3-13BParams=13B, expert_knowledge_inclusion=false2024.11 | 21.4 | 32.1 | 39.3 | |
| VILA-M3-8BParams=8B, expert_knowledge_inclusion=true2024.11 | 21.2 | 32.1 | 39.7 | |
| Med-GeminiParams=1.5T, expert_knowledge_inclusion=false2024.11 | 20.5 | 28.3 | — | |
| Med-GeminiParams=1.5T, expert_knowledge_inclusion=true2024.11 | 20.5 | 28.3 | — | |
| VILA-M3-3BParams=3B, expert_knowledge_inclusion=true2024.11 | 20.2 | 31.7 | 39.1 | |
| VILA-M3-3BParams=3B, expert_knowledge_inclusion=false2024.11 | 19.7 | 31.4 | 39.4 | |
| Llava-RadParams=7B, expert_knowledge_inclusion=false2024.11 | 15.4 | 30.6 | — | |
| Llava-RadParams=7B, expert_knowledge_inclusion=true2024.11 | 15.4 | 30.6 | — | |
| DCLParams=0.25B, expert_knowledge_inclusion=false2024.11 | 10.9 | 28.4 | — | |
| DCLParams=0.25B, expert_knowledge_inclusion=true2024.11 | 10.9 | 28.4 | — | |
| Llava-MedParams=7B, expert_knowledge_inclusion=false2024.11 | 1 | 13.3 | — | |
| Llava-MedParams=7B, expert_knowledge_inclusion=true2024.11 | 1 | 13.3 | — |