List your company
ResearchFormerly WizWand

3D Medical Report Generation on AMOS-MM 1.0 (test)

39.518ROUGE-1Original
12.3230419.3832726.443533.50373Mar 12, 2026
Updated 7mo ago

Evaluation results

MethodLinks
OriginalBackbone=Hulu-Med-7B [11], R-Rate=100.00%, Speed=9.2122026.0339.51828.76337.31713.37531.729100
MedPrunerBackbone=Hulu-Med-7B [11], R-Rate=54.20%, Speed=7.9312026.0339.25528.8637.33913.1231.13699.19
HiPruneBackbone=Hulu-Med-7B [11], R-Rate=22.30%, Speed=9.1112026.0339.09327.95635.76412.51331.08696.7
VisionZipBackbone=Hulu-Med-7B [11], R-Rate=49.69%, Speed=8.4352026.0338.51928.21636.87612.70530.73897.25
Hulu-L1Backbone=Hulu-Med-7B [11], R-Rate=16.35%, Speed=8.0392026.0333.06324.82630.7549.79926.21281.65
MedPrunerBackbone=Qwen3-VL-8B [3], R-Rate=43.28%, Speed=9.0442026.0319.46917.90826.1190.93717.64895.86
OriginalBackbone=Qwen3-VL-8B [3], R-Rate=100.00%, Speed=11.1792026.0318.71718.31726.9941.07718.821100
VisionBackbone=Qwen3-VL-8B [3], R-Rate=49.61%, Speed=10.6542026.0318.5918.04725.6040.92518.11694.98
HiPruneBackbone=Qwen3-VL-8B [3], R-Rate=22.30%, Speed=10.0522026.0318.21717.25525.8860.91918.694.33
Hulu-L1Backbone=Qwen3-VL-8B [3], R-Rate=16.50%, Speed=9.5692026.0318.20117.80825.8390.8717.78893.1
Hulu-L1Backbone=MedGemma1.5-4B [20], R-Rate=16.07%, Speed=36.1932026.0313.9999.7875.8430.2419.78299.25
VisionZipBackbone=MedGemma1.5-4B [20], R-Rate=49.61%, Speed=36.6822026.0313.8310.0436.050.2610.129102.42
OriginalBackbone=MedGemma1.5-4B [20], R-Rate=100.00%, Speed=38.0012026.0313.7919.9065.8450.2539.721100
MedPrunerBackbone=MedGemma1.5-4B [20], R-Rate=2.46%, Speed=35.8892026.0313.70610.2345.9850.23510.252100.65
HiPruneBackbone=MedGemma1.5-4B [20], R-Rate=21.85%, Speed=37.6192026.0313.3699.7825.8280.2369.93998.21