Text-to-Image Retrieval on FETA manually curated Car-Manuals 1.0
43.5Recall@1CLIP-MIL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CLIP-MILLocked=true, Shot-count scenario=Many-Shot2022.09 | 43.5 | 70.2 | 85.3 | |
| CLIP-MILLocked=false, Shot-count scenario=Many-Shot2022.09 | 40.7 | 67.6 | 86.5 | |
| Choose-OneLocked=false, Shot-count scenario=Many-Shot2022.09 | 34 | 65 | 84.7 | |
| Choose-OneLocked=true, Shot-count scenario=Many-Shot2022.09 | 33.7 | 68.3 | 82.6 | |
| ConcatenateLocked=true, Shot-count scenario=Many-Shot2022.09 | 28.8 | 56.4 | 76.3 | |
| ConcatenateLocked=false, Shot-count scenario=Many-Shot2022.09 | 24.5 | 56.5 | 80.5 | |
| CLIPLocked=false, Shot-count scenario=Many-Shot2022.09 | 23.7 | 53.4 | 72.9 | |
| CLIP-MILLocked=false, Shot-count scenario=Zero-Shot2022.09 | 16.2 | 40.4 | 62.6 | |
| CLIP-MILLocked=true, Shot-count scenario=Zero-Shot2022.09 | 15.1 | 43.2 | 60.8 | |
| CLIP-MILLocked=true, Shot-count scenario=One-Shot2022.09 | 14.9 | 41.6 | 62.5 | |
| CLIPLocked=false, Shot-count scenario=Zero-Shot2022.09 | 14.7 | 36.4 | 57 | |
| CLIPLocked=false, Shot-count scenario=One-Shot2022.09 | 14.7 | 36.4 | 57 | |
| CLIP-MILLocked=false, Shot-count scenario=One-Shot2022.09 | 14.6 | 43.6 | 64 | |
| Choose-OneLocked=true, Shot-count scenario=Zero-Shot2022.09 | 14.2 | 41.9 | 60 | |
| Choose-OneLocked=true, Shot-count scenario=One-Shot2022.09 | 14.2 | 39.5 | 62.1 | |
| Choose-OneLocked=false, Shot-count scenario=Zero-Shot2022.09 | 13.3 | 38.2 | 59.9 | |
| CLIP-MILLocked=true, Shot-count scenario=Few-Shot2022.09 | 13.2 | 38.6 | 61.6 | |
| ConcatenateLocked=true, Shot-count scenario=One-Shot2022.09 | 13 | 35.3 | 54.9 | |
| CLIP-MILLocked=false, Shot-count scenario=Few-Shot2022.09 | 12.7 | 38.2 | 60.5 | |
| CLIPLocked=false, Shot-count scenario=Few-Shot2022.09 | 12.5 | 32.1 | 53 | |
| Choose-OneLocked=false, Shot-count scenario=Few-Shot2022.09 | 12.5 | 36.4 | 60.1 | |
| Choose-OneLocked=false, Shot-count scenario=One-Shot2022.09 | 12.4 | 37.8 | 63.2 | |
| ConcatenateLocked=false, Shot-count scenario=One-Shot2022.09 | 12.1 | 39.1 | 60.8 | |
| ConcatenateLocked=true, Shot-count scenario=Zero-Shot2022.09 | 11.7 | 31.5 | 51.5 | |
| ConcatenateLocked=false, Shot-count scenario=Zero-Shot2022.09 | 11.5 | 33.6 | 51.9 | |
| ConcatenateLocked=false, Shot-count scenario=Few-Shot2022.09 | 11 | 32.5 | 54.7 | |
| Choose-OneLocked=true, Shot-count scenario=Few-Shot2022.09 | 10.1 | 35.7 | 59.7 | |
| ConcatenateLocked=true, Shot-count scenario=Few-Shot2022.09 | 8.8 | 28.9 | 51.3 |