Image Retrieval on COFAR Unified 1K Gallery (test)
40R@1KRAMT (Oracle)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| KRAMT (Oracle)Vision=true, Knowledge=true, Oracle=true2022.10 | 40 | 73.2 | 84.5 | 2 | |
| KRAMTVision=true, Knowledge=true2022.10 | 31.6 | 64.4 | 76.2 | 3 | |
| VinVLType=Vision-only2022.10 | 30.5 | — | 74.3 | 4 | |
| ViLBERTType=Vision-only2022.10 | 29.8 | 57.9 | 71 | 3 | |
| KRISP-inspired modelType=Knowledge-aware V-L2022.10 | 28.1 | 53.8 | 69 | 4 | |
| VisualBERTType=Vision-only2022.10 | 22.7 | 50 | 62.5 | 5 | |
| KQIAType=Knowledge-aware V-L2022.10 | 22 | 52.4 | 64.5 | 5 | |
| KRAMT (w/o Knowledge)Vision=true, Knowledge=false2022.10 | 19.8 | 39.1 | 49.8 | 14 | |
| KRAMTVision=true, Knowledge=true2022.10 | 19.7 | 44.7 | 51.3 | 8 | |
| VinVL2022.10 | 18.3 | 38.9 | 46.5 | 10 | |
| Modified Memory NetworkType=Knowledge-aware V-L2022.10 | 15.2 | 35 | 50.3 | 5 | |
| VSE++Type=Vision-only2022.10 | 7.4 | 19.2 | 23.8 | 68 | |
| Sentence similarityType=Knowledge-only2022.10 | 3.1 | 8.7 | 19 | 84 | |
| KRAMT (w/o Vision)Vision=false, Knowledge=true2022.10 | 1.9 | 6.6 | 12.6 | 57 |