3D Medical Report Generation on AMOS-MM 1.0 (test)
39.518ROUGE-1Original
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| OriginalBackbone=Hulu-Med-7B [11], R-Rate=100.00%, Speed=9.2122026.03 | 39.518 | 28.763 | 37.317 | 13.375 | 31.729 | 100 | |
| MedPrunerBackbone=Hulu-Med-7B [11], R-Rate=54.20%, Speed=7.9312026.03 | 39.255 | 28.86 | 37.339 | 13.12 | 31.136 | 99.19 | |
| HiPruneBackbone=Hulu-Med-7B [11], R-Rate=22.30%, Speed=9.1112026.03 | 39.093 | 27.956 | 35.764 | 12.513 | 31.086 | 96.7 | |
| VisionZipBackbone=Hulu-Med-7B [11], R-Rate=49.69%, Speed=8.4352026.03 | 38.519 | 28.216 | 36.876 | 12.705 | 30.738 | 97.25 | |
| Hulu-L1Backbone=Hulu-Med-7B [11], R-Rate=16.35%, Speed=8.0392026.03 | 33.063 | 24.826 | 30.754 | 9.799 | 26.212 | 81.65 | |
| MedPrunerBackbone=Qwen3-VL-8B [3], R-Rate=43.28%, Speed=9.0442026.03 | 19.469 | 17.908 | 26.119 | 0.937 | 17.648 | 95.86 | |
| OriginalBackbone=Qwen3-VL-8B [3], R-Rate=100.00%, Speed=11.1792026.03 | 18.717 | 18.317 | 26.994 | 1.077 | 18.821 | 100 | |
| VisionBackbone=Qwen3-VL-8B [3], R-Rate=49.61%, Speed=10.6542026.03 | 18.59 | 18.047 | 25.604 | 0.925 | 18.116 | 94.98 | |
| HiPruneBackbone=Qwen3-VL-8B [3], R-Rate=22.30%, Speed=10.0522026.03 | 18.217 | 17.255 | 25.886 | 0.919 | 18.6 | 94.33 | |
| Hulu-L1Backbone=Qwen3-VL-8B [3], R-Rate=16.50%, Speed=9.5692026.03 | 18.201 | 17.808 | 25.839 | 0.87 | 17.788 | 93.1 | |
| Hulu-L1Backbone=MedGemma1.5-4B [20], R-Rate=16.07%, Speed=36.1932026.03 | 13.999 | 9.787 | 5.843 | 0.241 | 9.782 | 99.25 | |
| VisionZipBackbone=MedGemma1.5-4B [20], R-Rate=49.61%, Speed=36.6822026.03 | 13.83 | 10.043 | 6.05 | 0.26 | 10.129 | 102.42 | |
| OriginalBackbone=MedGemma1.5-4B [20], R-Rate=100.00%, Speed=38.0012026.03 | 13.791 | 9.906 | 5.845 | 0.253 | 9.721 | 100 | |
| MedPrunerBackbone=MedGemma1.5-4B [20], R-Rate=2.46%, Speed=35.8892026.03 | 13.706 | 10.234 | 5.985 | 0.235 | 10.252 | 100.65 | |
| HiPruneBackbone=MedGemma1.5-4B [20], R-Rate=21.85%, Speed=37.6192026.03 | 13.369 | 9.782 | 5.828 | 0.236 | 9.939 | 98.21 |