Composed Retrieval on Quilt-VQA (test)
35.8R@1HOMIE (Qwen3-VL-8B)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HOMIE (Qwen3-VL-8B)Model Category=MLLM-Based2025.02 | 35.8 | 64.1 | 72.8 | |
| HOMIE (Qwen3-VL-2B)Model Category=MLLM-Based2025.02 | 34.4 | 61.9 | 69.8 | |
| MUSKFusion Strategy=Add, Model Category=Dual-Encoder2025.02 | 34.1 | 53 | 58.4 | |
| Pathgen-CLIPFusion Strategy=Add, Model Category=Dual-Encoder2025.02 | 28.2 | 41.6 | 46 | |
| Pathgen-CLIP-LFusion Strategy=Add, Model Category=Dual-Encoder2025.02 | 26.4 | 39.6 | 44.8 | |
| LamRA-7BModel Category=MLLM-Based2025.02 | 23.6 | 37.4 | 44.3 | |
| GME-7BModel Category=MLLM-Based2025.02 | 23.5 | 33.3 | 39.9 | |
| PLIPFusion Strategy=Add, Model Category=Dual-Encoder2025.02 | 22.1 | 33.7 | 39 | |
| Patho-CLIP-LFusion Strategy=Add, Model Category=Dual-Encoder2025.02 | 22.1 | 40.5 | 48.6 | |
| PathCLIPFusion Strategy=Add, Model Category=Dual-Encoder2025.02 | 21.3 | 36.3 | 40.6 | |
| PubmedCLIPFusion Strategy=Add, Model Category=Dual-Encoder2025.02 | 21.1 | 31.4 | 35.5 | |
| QuiltNetFusion Strategy=Add, Model Category=Dual-Encoder2025.02 | 18.9 | 29.4 | 34.7 | |
| MUSKFusion Strategy=RRF, Model Category=Dual-Encoder2025.02 | 17.5 | 30.5 | 39.5 | |
| Lingshu-7BModel Category=MLLM-Based2025.02 | 17.5 | 30.7 | 37 | |
| Qwen2.5-VL-7BModel Category=MLLM-Based2025.02 | 14.4 | 27.6 | 35.1 | |
| PathoR1-7BModel Category=MLLM-Based2025.02 | 14.2 | 28.7 | 35.1 | |
| Patho-CLIPFusion Strategy=Add, Model Category=Dual-Encoder2025.02 | 14.1 | 28.7 | 35.5 | |
| HuatuoGPT-V-7BModel Category=MLLM-Based2025.02 | 11.6 | 22.5 | 29 | |
| BiomedCLIPFusion Strategy=Add, Model Category=Dual-Encoder2025.02 | 10.9 | 24 | 31.1 | |
| Pathgen-CLIPFusion Strategy=RRF, Model Category=Dual-Encoder2025.02 | 9.9 | 19.9 | 27.5 | |
| Patho-CLIP-LFusion Strategy=RRF, Model Category=Dual-Encoder2025.02 | 9.8 | 22.4 | 30.1 | |
| CONCHFusion Strategy=Add, Model Category=Dual-Encoder2025.02 | 9.7 | 25.6 | 36 | |
| Pathgen-CLIP-LFusion Strategy=RRF, Model Category=Dual-Encoder2025.02 | 8 | 19.5 | 26.2 | |
| Qwen3-VL-8BModel Category=MLLM-Based2025.02 | 7.2 | 14.1 | 18.2 | |
| Patho-CLIPFusion Strategy=RRF, Model Category=Dual-Encoder2025.02 | 6.9 | 16.2 | 22.8 | |
| QuiltNetFusion Strategy=RRF, Model Category=Dual-Encoder2025.02 | 4.8 | 11.9 | 17.5 | |
| CONCHFusion Strategy=RRF, Model Category=Dual-Encoder2025.02 | 4.3 | 13.5 | 23.6 | |
| BiomedCLIPFusion Strategy=RRF, Model Category=Dual-Encoder2025.02 | 3.9 | 10.1 | 16.6 | |
| Qwen3-VL-2BModel Category=MLLM-Based2025.02 | 3.6 | 8.7 | 11.9 | |
| E5-V-7BModel Category=MLLM-Based2025.02 | 3.6 | 7.6 | 10.4 | |
| PathCLIPFusion Strategy=RRF, Model Category=Dual-Encoder2025.02 | 3.3 | 9.9 | 16.3 | |
| PLIPFusion Strategy=RRF, Model Category=Dual-Encoder2025.02 | 2.9 | 10.5 | 15.1 | |
| PubmedCLIPFusion Strategy=RRF, Model Category=Dual-Encoder2025.02 | 1.7 | 7.5 | 14.4 |