Visual Difference Discovery on VisDiffBench PIS-Medium
75Acc@1Image-based Proposer (GPT-4V) + Feature-based Ranker (CLIP)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Image-based Proposer (GPT-4V) + Feature-based Ranker (CLIP)Proposer=Image (GPT-4V), Ranker=Feature (CLIP)2023.12 | 75 | 87 | |
| VisDiff (Caption-based Proposer + Feature-based Ranker)Proposer=Caption (BLIP-2 + GPT-4), Ranker=Feature (CLIP)2023.12 | 75 | 86 | |
| Caption-based Proposer (BLIP-2 + GPT-4) + Image-based Ranker (LLaVA-1.5)Proposer=Caption (BLIP-2 + GPT-4), Ranker=Image (LLaVA-1.5)2023.12 | 58 | 80 | |
| Caption-based Proposer (BLIP-2 + GPT-4) + Caption-based Ranker (Vicuna-1.5)Proposer=Caption (BLIP-2 + GPT-4), Ranker=Caption (Vicuna-1.5)2023.12 | 49 | 77 | |
| Image-based Proposer (LLaVA-1.5) + Feature-based Ranker (CLIP)Proposer=Image (LLaVA-1.5), Ranker=Feature (CLIP)2023.12 | 39 | 49 | |
| Feature-based Proposer (BLIP-2) + Feature-based Ranker (CLIP)Proposer=Feature (BLIP-2), Ranker=Feature (CLIP)2023.12 | 13 | 33 |