# Text-to-Image Retrieval on FETA manually curated Car-Manuals 1.0 Source: [Text-to-Image Retrieval on FETA manually curated Car-Manuals 1.0]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:01:22.994Z Evaluation of Text-to-Image Retrieval performance on the FETA manually curated Car-Manuals 1.0 dataset, measured using Recall@K metrics (R@1, R@5, R@10). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Text-to-Image Retrieval | | Dataset (including any stated split) | FETA manually curated Car-Manuals 1.0 | | Metric | Recall@1 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Recall@1](): Higher is better; unit: PERCENT. - [Recall@5](): Higher is better; unit: PERCENT. - [Recall@10](): Higher is better; unit: PERCENT. ## Recorded results | Method | Recall@1 | Result date | Report paper | | --- | --- | --- | --- | | CLIP-MIL | 43.5 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 40.7 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 34 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 33.7 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 28.8 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 24.5 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP | 23.7 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 16.2 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 15.1 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 14.9 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP | 14.7 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP | 14.7 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 14.6 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 14.2 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 14.2 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 13.3 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 13.2 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 13 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 12.7 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP | 12.5 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 12.5 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 12.4 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 12.1 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 11.7 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 11.5 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 11 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 10.1 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 8.8 | Not recorded | 68fa6e421e209131cea3ec38 | ### CLIP-MIL Recall@1: 43.5. Result ID: 69900a513a6c314849fdb01e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL Recall@1: 40.7. Result ID: 69900a513a6c314849fdb01d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### Choose-One Recall@1: 34. Result ID: 69900a513a6c314849fdb01b. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### Choose-One Recall@1: 33.7. Result ID: 69900a513a6c314849fdb01c. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### Concatenate Recall@1: 28.8. Result ID: 69900a513a6c314849fdb01a. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### Concatenate Recall@1: 24.5. Result ID: 69900a513a6c314849fdb019. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### CLIP Recall@1: 23.7. Result ID: 69900a513a6c314849fdb018. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL Recall@1: 16.2. Result ID: 69900a513a6c314849fdb008. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL Recall@1: 15.1. Result ID: 69900a513a6c314849fdb009. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL Recall@1: 14.9. Result ID: 69900a513a6c314849fdb010. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### CLIP Recall@1: 14.7. Result ID: 69900a513a6c314849fdb003. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### CLIP Recall@1: 14.7. Result ID: 69900a513a6c314849fdb00a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL Recall@1: 14.6. Result ID: 69900a513a6c314849fdb00f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### Choose-One Recall@1: 14.2. Result ID: 69900a513a6c314849fdb007. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### Choose-One Recall@1: 14.2. Result ID: 69900a513a6c314849fdb00e. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### Choose-One Recall@1: 13.3. Result ID: 69900a513a6c314849fdb006. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL Recall@1: 13.2. Result ID: 69900a513a6c314849fdb017. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. ### Concatenate Recall@1: 13. Result ID: 69900a513a6c314849fdb00c. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL Recall@1: 12.7. Result ID: 69900a513a6c314849fdb016. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. ### CLIP Recall@1: 12.5. Result ID: 69900a513a6c314849fdb011. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. ### Choose-One Recall@1: 12.5. Result ID: 69900a513a6c314849fdb014. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. ### Choose-One Recall@1: 12.4. Result ID: 69900a513a6c314849fdb00d. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### Concatenate Recall@1: 12.1. Result ID: 69900a513a6c314849fdb00b. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### Concatenate Recall@1: 11.7. Result ID: 69900a513a6c314849fdb005. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### Concatenate Recall@1: 11.5. Result ID: 69900a513a6c314849fdb004. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### Concatenate Recall@1: 11. Result ID: 69900a513a6c314849fdb012. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. ### Choose-One Recall@1: 10.1. Result ID: 69900a513a6c314849fdb015. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. ### Concatenate Recall@1: 8.8. Result ID: 69900a513a6c314849fdb013. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.