# Relation-Conditioned Retrieval on Auto (MRR) Source: [Relation-Conditioned Retrieval on Auto (MRR)]() Collection index: [llms.txt]() Data updated: 2026-05-12T08:12:41.485Z Evaluation of Relation-Conditioned Retrieval performance on the Auto dataset, measured using MRR. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Relation-Conditioned Retrieval | | Dataset (including any stated split) | Auto | | Metric | MRR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [MRR](): Higher is better; unit: PERCENT. ## Recorded results | Method | MRR | Result date | Report paper | | --- | --- | --- | --- | | RCML | 30.34 | Not recorded | 68fa7ae71e209131cea85cf0 | | RCML | 29.38 | Not recorded | 68fa7ae71e209131cea85cf0 | | ImageBind | 27.78 | Not recorded | 68fa7ae71e209131cea85cf0 | | ImageBind | 27.69 | Not recorded | 68fa7ae71e209131cea85cf0 | | RCML | 27.64 | Not recorded | 68fa7ae71e209131cea85cf0 | | SigLIP | 27.22 | Not recorded | 68fa7ae71e209131cea85cf0 | | SigLIP | 27.02 | Not recorded | 68fa7ae71e209131cea85cf0 | | ImageBind | 26.1 | Not recorded | 68fa7ae71e209131cea85cf0 | | CLIP | 25.95 | Not recorded | 68fa7ae71e209131cea85cf0 | | ImageBind | 25.77 | Not recorded | 68fa7ae71e209131cea85cf0 | | ImageBind | 25.62 | Not recorded | 68fa7ae71e209131cea85cf0 | | CLIP | 25.33 | Not recorded | 68fa7ae71e209131cea85cf0 | | RCML | 25.32 | Not recorded | 68fa7ae71e209131cea85cf0 | | SigLIP | 25.18 | Not recorded | 68fa7ae71e209131cea85cf0 | | RCML | 25.16 | Not recorded | 68fa7ae71e209131cea85cf0 | | SigLIP | 25.03 | Not recorded | 68fa7ae71e209131cea85cf0 | | SigLIP | 24.61 | Not recorded | 68fa7ae71e209131cea85cf0 | | CLIP | 23.36 | Not recorded | 68fa7ae71e209131cea85cf0 | | CLIP | 22.85 | Not recorded | 68fa7ae71e209131cea85cf0 | | CLIP | 21.69 | Not recorded | 68fa7ae71e209131cea85cf0 | | UniCL | 21.02 | Not recorded | 68fa7ae71e209131cea85cf0 | | UniCL | 20.88 | Not recorded | 68fa7ae71e209131cea85cf0 | | DeCLIP | 20.16 | Not recorded | 68fa7ae71e209131cea85cf0 | | DeCLIP | 19.98 | Not recorded | 68fa7ae71e209131cea85cf0 | | UniCL | 18.99 | Not recorded | 68fa7ae71e209131cea85cf0 | | UniCL | 18.06 | Not recorded | 68fa7ae71e209131cea85cf0 | | DeCLIP | 17.99 | Not recorded | 68fa7ae71e209131cea85cf0 | | UniCL | 17.34 | Not recorded | 68fa7ae71e209131cea85cf0 | | DeCLIP | 16.94 | Not recorded | 68fa7ae71e209131cea85cf0 | | DeCLIP | 16.81 | Not recorded | 68fa7ae71e209131cea85cf0 | ### RCML MRR: 30.34. Result ID: 6a02e0e747f34ce924e58d3c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TT"}. This record does not assert independent reproduction. ### RCML MRR: 29.38. Result ID: 6a02e0e747f34ce924e58d40. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"AVG"}. This record does not assert independent reproduction. ### ImageBind MRR: 27.78. Result ID: 6a02e0e747f34ce924e58d3b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"AVG"}. This record does not assert independent reproduction. ### ImageBind MRR: 27.69. Result ID: 6a02e0e747f34ce924e58d37. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"TT"}. This record does not assert independent reproduction. ### RCML MRR: 27.64. Result ID: 6a02e0e747f34ce924e58d3f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"IT"}. This record does not assert independent reproduction. ### SigLIP MRR: 27.22. Result ID: 6a02e0e747f34ce924e58d32. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TT"}. This record does not assert independent reproduction. ### SigLIP MRR: 27.02. Result ID: 6a02e0e747f34ce924e58d36. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"AVG"}. This record does not assert independent reproduction. ### ImageBind MRR: 26.1. Result ID: 6a02e0e747f34ce924e58d39. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"TI"}. This record does not assert independent reproduction. ### CLIP MRR: 25.95. Result ID: 6a02e0e747f34ce924e58d23. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"TT"}. This record does not assert independent reproduction. ### ImageBind MRR: 25.77. Result ID: 6a02e0e747f34ce924e58d3a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"IT"}. This record does not assert independent reproduction. ### ImageBind MRR: 25.62. Result ID: 6a02e0e747f34ce924e58d38. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"II"}. This record does not assert independent reproduction. ### CLIP MRR: 25.33. Result ID: 6a02e0e747f34ce924e58d27. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"AVG"}. This record does not assert independent reproduction. ### RCML MRR: 25.32. Result ID: 6a02e0e747f34ce924e58d3e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TI"}. This record does not assert independent reproduction. ### SigLIP MRR: 25.18. Result ID: 6a02e0e747f34ce924e58d34. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TI"}. This record does not assert independent reproduction. ### RCML MRR: 25.16. Result ID: 6a02e0e747f34ce924e58d3d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"II"}. This record does not assert independent reproduction. ### SigLIP MRR: 25.03. Result ID: 6a02e0e747f34ce924e58d35. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"IT"}. This record does not assert independent reproduction. ### SigLIP MRR: 24.61. Result ID: 6a02e0e747f34ce924e58d33. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"II"}. This record does not assert independent reproduction. ### CLIP MRR: 23.36. Result ID: 6a02e0e747f34ce924e58d26. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"IT"}. This record does not assert independent reproduction. ### CLIP MRR: 22.85. Result ID: 6a02e0e747f34ce924e58d25. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"TI"}. This record does not assert independent reproduction. ### CLIP MRR: 21.69. Result ID: 6a02e0e747f34ce924e58d24. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"II"}. This record does not assert independent reproduction. ### UniCL MRR: 21.02. Result ID: 6a02e0e747f34ce924e58d31. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"AVG"}. This record does not assert independent reproduction. ### UniCL MRR: 20.88. Result ID: 6a02e0e747f34ce924e58d2e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"II"}. This record does not assert independent reproduction. ### DeCLIP MRR: 20.16. Result ID: 6a02e0e747f34ce924e58d28. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TT"}. This record does not assert independent reproduction. ### DeCLIP MRR: 19.98. Result ID: 6a02e0e747f34ce924e58d2c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"AVG"}. This record does not assert independent reproduction. ### UniCL MRR: 18.99. Result ID: 6a02e0e747f34ce924e58d2d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TT"}. This record does not assert independent reproduction. ### UniCL MRR: 18.06. Result ID: 6a02e0e747f34ce924e58d2f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TI"}. This record does not assert independent reproduction. ### DeCLIP MRR: 17.99. Result ID: 6a02e0e747f34ce924e58d29. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"II"}. This record does not assert independent reproduction. ### UniCL MRR: 17.34. Result ID: 6a02e0e747f34ce924e58d30. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"IT"}. This record does not assert independent reproduction. ### DeCLIP MRR: 16.94. Result ID: 6a02e0e747f34ce924e58d2a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TI"}. This record does not assert independent reproduction. ### DeCLIP MRR: 16.81. Result ID: 6a02e0e747f34ce924e58d2b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"IT"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.