Image-Text Matching on Sugar-Crepe
93.5AccuracyLamRA
Evaluation Results
| Method | Links | |
|---|---|---|
| LamRAreranking=pointwise/listwise2024.12 | 93.5 | |
| LamRAReranker=true2025.07 | 93.5 | |
| U-MARVEL+Reranker=true2025.07 | 93.4 | |
| ELVA-7BEvaluation Protocol=ITM2026.06 | 91.1 | |
| U-MARVELReranker=false2025.07 | 87.9 | |
| LamRA-Ret2024.12 | 85.8 | |
| LamRA-RetReranker=false2025.07 | 85.8 | |
| LamRA-Ret-7BEvaluation Protocol=ITM2026.06 | 85.8 | |
| UniMEReranker=false2025.07 | 85 | |
| E5-V2024.12 | 84.7 | |
| E5-VReranker=false2025.07 | 84.7 | |
| E5-VEvaluation Protocol=ITM2026.06 | 84.7 | |
| EVA-CLIPparameters=18B2024.12 | 83.1 | |
| EVA-CLIP-18BEvaluation Protocol=ITM2026.06 | 83.1 | |
| EVA-CLIPparameters=8B2024.12 | 81.7 | |
| EVA-CLIP-8BEvaluation Protocol=ITM2026.06 | 81.7 | |
| Long-CLIP-L2024.12 | 80.9 | |
| Long-CLIP-LEvaluation Protocol=ITM2026.06 | 80.9 | |
| UniIR-CLIP2024.12 | 80.3 | |
| UniIR-CLIP_SFReranker=false2025.07 | 80.3 | |
| UniIR-CLIPEvaluation Protocol=ITM2026.06 | 80.3 | |
| VLM2VecReranker=false2025.07 | 79.5 | |
| MagicLens-L2024.12 | 75.9 | |
| MagicLens-LReranker=false2025.07 | 75.9 | |
| MagicLens-LEvaluation Protocol=ITM2026.06 | 75.9 | |
| CLIP-L2024.12 | 73 | |
| CLIP-LReranker=false2025.07 | 73 | |
| CLIP-LEvaluation Protocol=ITM2026.06 | 73 |