# Image-to-Text Retrieval on FETA manually curated Car-Manuals 1.0 Source: [Image-to-Text Retrieval on FETA manually curated Car-Manuals 1.0]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:59:24.380Z Evaluation of Image-to-Text Retrieval performance on the FETA manually curated Car-Manuals 1.0 dataset, measured using Recall@K metrics (R@1, R@5, R@10). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Image-to-Text Retrieval | | Dataset (including any stated split) | FETA manually curated Car-Manuals 1.0 | | Metric | R@1 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [R@1](): Higher is better; unit: PERCENT. - [R@5](): Higher is better; unit: PERCENT. - [R@10](): Higher is better; unit: PERCENT. ## Recorded results | Method | R@1 | Result date | Report paper | | --- | --- | --- | --- | | CLIP-MIL | 43.1 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 43 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 39 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 36.8 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 34.6 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 29.9 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP | 20 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 16.1 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 15.8 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 15.7 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 14.4 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP | 14.3 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP | 14.3 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 14.2 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 13.9 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 13.4 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP-MIL | 12.9 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 12.8 | Not recorded | 68fa6e421e209131cea3ec38 | | CLIP | 12.8 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 12.7 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 12.4 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 12.4 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 12 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 11 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 9.8 | Not recorded | 68fa6e421e209131cea3ec38 | | Choose-One | 9.8 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 9.3 | Not recorded | 68fa6e421e209131cea3ec38 | | Concatenate | 8.2 | Not recorded | 68fa6e421e209131cea3ec38 | ### CLIP-MIL R@1: 43.1. Result ID: 69900a513a6c314849fdb001. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL R@1: 43. Result ID: 69900a513a6c314849fdb002. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### Choose-One R@1: 39. Result ID: 69900a513a6c314849fdafff. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### Concatenate R@1: 36.8. Result ID: 69900a513a6c314849fdaffd. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### Choose-One R@1: 34.6. Result ID: 69900a513a6c314849fdb000. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### Concatenate R@1: 29.9. Result ID: 69900a513a6c314849fdaffe. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### CLIP R@1: 20. Result ID: 69900a513a6c314849fdaffc. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Many-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL R@1: 16.1. Result ID: 69900a513a6c314849fdaff3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL R@1: 15.8. Result ID: 69900a513a6c314849fdaff4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### Concatenate R@1: 15.7. Result ID: 69900a513a6c314849fdafef. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL R@1: 14.4. Result ID: 69900a513a6c314849fdafec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### CLIP R@1: 14.3. Result ID: 69900a513a6c314849fdafe7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### CLIP R@1: 14.3. Result ID: 69900a513a6c314849fdafee. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### Concatenate R@1: 14.2. Result ID: 69900a513a6c314849fdafe8. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL R@1: 13.9. Result ID: 69900a513a6c314849fdafed. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL R@1: 13.4. Result ID: 69900a513a6c314849fdaffa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. ### CLIP-MIL R@1: 12.9. Result ID: 69900a513a6c314849fdaffb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. ### Choose-One R@1: 12.8. Result ID: 69900a513a6c314849fdafeb. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### CLIP R@1: 12.8. Result ID: 69900a513a6c314849fdaff5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. ### Choose-One R@1: 12.7. Result ID: 69900a513a6c314849fdaff1. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### Concatenate R@1: 12.4. Result ID: 69900a513a6c314849fdaff0. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### Choose-One R@1: 12.4. Result ID: 69900a513a6c314849fdaff2. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"One-Shot"}. This record does not assert independent reproduction. ### Concatenate R@1: 12. Result ID: 69900a513a6c314849fdaff6. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. ### Choose-One R@1: 11. Result ID: 69900a513a6c314849fdaff8. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. ### Choose-One R@1: 9.8. Result ID: 69900a513a6c314849fdafea. [Reporting paper]() Recorded evaluation configuration: {"Locked":false,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### Choose-One R@1: 9.8. Result ID: 69900a513a6c314849fdaff9. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. ### Concatenate R@1: 9.3. Result ID: 69900a513a6c314849fdafe9. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Zero-Shot"}. This record does not assert independent reproduction. ### Concatenate R@1: 8.2. Result ID: 69900a513a6c314849fdaff7. [Reporting paper]() Recorded evaluation configuration: {"Locked":true,"Shot-count scenario":"Few-Shot"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.