Image-to-Text Retrieval on FETA manually curated Car-Manuals 1.0
43.1R@1CLIP-MIL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CLIP-MILLocked=false, Shot-count scenario=Many-Shot2022.09 | 43.1 | 71.4 | 83.8 | |
| CLIP-MILLocked=true, Shot-count scenario=Many-Shot2022.09 | 43 | 74.8 | 85.7 | |
| Choose-OneLocked=false, Shot-count scenario=Many-Shot2022.09 | 39 | 70.1 | 83.1 | |
| ConcatenateLocked=false, Shot-count scenario=Many-Shot2022.09 | 36.8 | 66.6 | 84.1 | |
| Choose-OneLocked=true, Shot-count scenario=Many-Shot2022.09 | 34.6 | 70.6 | 83.5 | |
| ConcatenateLocked=true, Shot-count scenario=Many-Shot2022.09 | 29.9 | 61.6 | 81.1 | |
| CLIPLocked=false, Shot-count scenario=Many-Shot2022.09 | 20 | 47.2 | 71.3 | |
| CLIP-MILLocked=false, Shot-count scenario=One-Shot2022.09 | 16.1 | 42.7 | 66.2 | |
| CLIP-MILLocked=true, Shot-count scenario=One-Shot2022.09 | 15.8 | 39.9 | 62.6 | |
| ConcatenateLocked=false, Shot-count scenario=One-Shot2022.09 | 15.7 | 41.9 | 63.3 | |
| CLIP-MILLocked=false, Shot-count scenario=Zero-Shot2022.09 | 14.4 | 40.1 | 67.8 | |
| CLIPLocked=false, Shot-count scenario=Zero-Shot2022.09 | 14.3 | 39.3 | 55.6 | |
| CLIPLocked=false, Shot-count scenario=One-Shot2022.09 | 14.3 | 39.3 | 55.6 | |
| ConcatenateLocked=false, Shot-count scenario=Zero-Shot2022.09 | 14.2 | 40.2 | 61.6 | |
| CLIP-MILLocked=true, Shot-count scenario=Zero-Shot2022.09 | 13.9 | 41 | 65 | |
| CLIP-MILLocked=false, Shot-count scenario=Few-Shot2022.09 | 13.4 | 41.3 | 61.9 | |
| CLIP-MILLocked=true, Shot-count scenario=Few-Shot2022.09 | 12.9 | 38.4 | 60.3 | |
| Choose-OneLocked=true, Shot-count scenario=Zero-Shot2022.09 | 12.8 | 40.5 | 59 | |
| CLIPLocked=false, Shot-count scenario=Few-Shot2022.09 | 12.8 | 37.3 | 51.7 | |
| Choose-OneLocked=false, Shot-count scenario=One-Shot2022.09 | 12.7 | 40.8 | 60.4 | |
| ConcatenateLocked=true, Shot-count scenario=One-Shot2022.09 | 12.4 | 37.7 | 54.1 | |
| Choose-OneLocked=true, Shot-count scenario=One-Shot2022.09 | 12.4 | 38.8 | 62.5 | |
| ConcatenateLocked=false, Shot-count scenario=Few-Shot2022.09 | 12 | 38.3 | 58.9 | |
| Choose-OneLocked=false, Shot-count scenario=Few-Shot2022.09 | 11 | 39.8 | 60.9 | |
| Choose-OneLocked=false, Shot-count scenario=Zero-Shot2022.09 | 9.8 | 39.1 | 59.9 | |
| Choose-OneLocked=true, Shot-count scenario=Few-Shot2022.09 | 9.8 | 37 | 59.5 | |
| ConcatenateLocked=true, Shot-count scenario=Zero-Shot2022.09 | 9.3 | 35.4 | 58.5 | |
| ConcatenateLocked=true, Shot-count scenario=Few-Shot2022.09 | 8.2 | 33 | 55.4 |