Text-to-Image Retrieval on Bookset zero-shot
31.5Recall@1HOMIE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HOMIEModel Category=MLLM-Based Models, Backbone=Qwen3-VL-8B, Evaluation Protocol=Zero-shot2025.02 | 31.5 | 60 | 72.7 | |
| HOMIEModel Category=MLLM-Based Models, Backbone=Qwen3-VL-2B, Evaluation Protocol=Zero-shot2025.02 | 29.7 | 54.7 | 65.1 | |
| Patho-CLIPModel Category=Pathology Dual-Encoder Models, Evaluation Protocol=Zero-shot2025.02 | 27.6 | 55.8 | 67.6 | |
| MUSKModel Category=Pathology Dual-Encoder Models, Evaluation Protocol=Zero-shot2025.02 | 25.3 | 50.1 | 62 | |
| CONCHModel Category=Pathology Dual-Encoder Models, Evaluation Protocol=Zero-shot2025.02 | 23.6 | 48.7 | 59.9 | |
| Patho-CLIP-LModel Category=Pathology Dual-Encoder Models, Evaluation Protocol=Zero-shot2025.02 | 21.9 | 49.3 | 62.6 | |
| Pathgen-CLIP-LModel Category=Pathology Dual-Encoder Models, Evaluation Protocol=Zero-shot2025.02 | 14.7 | 33.9 | 44.7 | |
| Pathgen-CLIPModel Category=Pathology Dual-Encoder Models, Evaluation Protocol=Zero-shot2025.02 | 14.1 | 34.2 | 45.2 | |
| BiomedCLIPModel Category=Pathology Dual-Encoder Models, Evaluation Protocol=Zero-shot2025.02 | 9.4 | 23.4 | 32 | |
| PathCLIPModel Category=Pathology Dual-Encoder Models, Evaluation Protocol=Zero-shot2025.02 | 8.8 | 21.3 | 29.5 | |
| PathoR1-7BModel Category=MLLM-Based Models, Backbone=7B, Evaluation Protocol=Zero-shot2025.02 | 7 | 18.4 | 25.2 | |
| QuiltNetModel Category=Pathology Dual-Encoder Models, Evaluation Protocol=Zero-shot2025.02 | 2.9 | 9.5 | 15.6 | |
| PLIPModel Category=Pathology Dual-Encoder Models, Evaluation Protocol=Zero-shot2025.02 | 2.3 | 8.1 | 13.2 | |
| Lingshu-7BModel Category=MLLM-Based Models, Backbone=7B, Evaluation Protocol=Zero-shot2025.02 | 1.3 | 4.8 | 6.8 | |
| E5-V-7BModel Category=MLLM-Based Models, Backbone=7B, Evaluation Protocol=Zero-shot2025.02 | 0.5 | 1.8 | 2.4 | |
| GME-7BModel Category=MLLM-Based Models, Backbone=7B, Evaluation Protocol=Zero-shot2025.02 | 0.5 | 2.3 | 4.1 | |
| Qwen2.5-VL-7BModel Category=MLLM-Based Models, Backbone=7B, Evaluation Protocol=Zero-shot2025.02 | 0.4 | 1.6 | 2.6 | |
| Qwen3-VL-8BModel Category=MLLM-Based Models, Backbone=8B, Evaluation Protocol=Zero-shot2025.02 | 0.4 | 1.5 | 3 | |
| HuatuoGPT-V-7BModel Category=MLLM-Based Models, Backbone=7B, Evaluation Protocol=Zero-shot2025.02 | 0.4 | 2 | 3.2 | |
| LamRA-7BModel Category=MLLM-Based Models, Backbone=7B, Evaluation Protocol=Zero-shot2025.02 | 0.3 | 1.2 | 1.7 | |
| PubmedCLIPModel Category=Pathology Dual-Encoder Models, Evaluation Protocol=Zero-shot2025.02 | 0.1 | 0.8 | 1.2 | |
| Qwen3-VL-2BModel Category=MLLM-Based Models, Backbone=2B, Evaluation Protocol=Zero-shot2025.02 | 0.1 | 0.8 | 1.3 |