Selective Captioning on CheXpert 5x200 (test)
0.264AURC (CIDEr-N)PAPSP
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PAPSPSP-VLM=SigLIP_SO-400M, P-VLM=Qwen-2.5-VL (7B)2026.01 | 0.264 | 0.313 | |
| MA-PAPSPSP-VLM=SigLIP_SO-400M, RS (Retrieval Set)=Out-of-domain, P-VLM=Qwen-2.5-VL (7B)2026.01 | 0.252 | 0.326 | |
| PAPSPSP-VLM=BioMedCLIP, P-VLM=Qwen-2.5-VL (7B)2026.01 | 0.164 | 0.238 | |
| MA-PAPSPSP-VLM=BioMedCLIP, RS (Retrieval Set)=MIMIC-CXR, P-VLM=Qwen-2.5-VL (7B)2026.01 | 0.138 | 0.208 | |
| MA-PAPSPSP-VLM=SigLIP_SO-400M, RS (Retrieval Set)=CheXpert, P-VLM=Qwen-2.5-VL (7B)2026.01 | 0.137 | 0.276 | |
| MA-PAPSPSP-VLM=SigLIP_SO-400M, RS (Retrieval Set)=Mixed, P-VLM=Qwen-2.5-VL (7B)2026.01 | 0.136 | 0.217 | |
| MA-PAPSPSP-VLM=BioMedCLIP, RS (Retrieval Set)=Mixed, P-VLM=Qwen-2.5-VL (7B)2026.01 | 0.136 | 0.204 | |
| MA-PAPSPSP-VLM=SigLIP_SO-400M, RS (Retrieval Set)=MIMIC-CXR, P-VLM=Qwen-2.5-VL (7B)2026.01 | 0.134 | 0.215 | |
| MA-PAPSPSP-VLM=BioMedCLIP, RS (Retrieval Set)=CheXpert, P-VLM=Qwen-2.5-VL (7B)2026.01 | 0.126 | 0.198 |