# Relation-Conditioned Retrieval on Pet (MRR) Source: [Relation-Conditioned Retrieval on Pet (MRR)]() Collection index: [llms.txt]() Data updated: 2026-05-12T08:12:41.577Z Evaluation of Relation-Conditioned Retrieval performance on the Pet dataset, measured using MRR. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Relation-Conditioned Retrieval | | Dataset (including any stated split) | Pet | | Metric | MRR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [MRR](): Higher is better; unit: PERCENT. ## Recorded results | Method | MRR | Result date | Report paper | | --- | --- | --- | --- | | RCML | 35.96 | Not recorded | 68fa7ae71e209131cea85cf0 | | RCML | 35.69 | Not recorded | 68fa7ae71e209131cea85cf0 | | RCML | 34.02 | Not recorded | 68fa7ae71e209131cea85cf0 | | RCML | 30.66 | Not recorded | 68fa7ae71e209131cea85cf0 | | RCML | 28.92 | Not recorded | 68fa7ae71e209131cea85cf0 | | ImageBind | 28.6 | Not recorded | 68fa7ae71e209131cea85cf0 | | ImageBind | 28.46 | Not recorded | 68fa7ae71e209131cea85cf0 | | ImageBind | 26.82 | Not recorded | 68fa7ae71e209131cea85cf0 | | CLIP | 26.72 | Not recorded | 68fa7ae71e209131cea85cf0 | | SigLIP | 26.72 | Not recorded | 68fa7ae71e209131cea85cf0 | | ImageBind | 26.49 | Not recorded | 68fa7ae71e209131cea85cf0 | | ImageBind | 26.4 | Not recorded | 68fa7ae71e209131cea85cf0 | | CLIP | 26.22 | Not recorded | 68fa7ae71e209131cea85cf0 | | SigLIP | 26.22 | Not recorded | 68fa7ae71e209131cea85cf0 | | UniCL | 24.4 | Not recorded | 68fa7ae71e209131cea85cf0 | | CLIP | 24.09 | Not recorded | 68fa7ae71e209131cea85cf0 | | SigLIP | 24.09 | Not recorded | 68fa7ae71e209131cea85cf0 | | UniCL | 23.82 | Not recorded | 68fa7ae71e209131cea85cf0 | | CLIP | 23.62 | Not recorded | 68fa7ae71e209131cea85cf0 | | SigLIP | 23.62 | Not recorded | 68fa7ae71e209131cea85cf0 | | CLIP | 22.56 | Not recorded | 68fa7ae71e209131cea85cf0 | | SigLIP | 22.56 | Not recorded | 68fa7ae71e209131cea85cf0 | | DeCLIP | 21.11 | Not recorded | 68fa7ae71e209131cea85cf0 | | DeCLIP | 20.85 | Not recorded | 68fa7ae71e209131cea85cf0 | | UniCL | 18.53 | Not recorded | 68fa7ae71e209131cea85cf0 | | DeCLIP | 18.11 | Not recorded | 68fa7ae71e209131cea85cf0 | | UniCL | 17.27 | Not recorded | 68fa7ae71e209131cea85cf0 | | UniCL | 17.06 | Not recorded | 68fa7ae71e209131cea85cf0 | | DeCLIP | 17.02 | Not recorded | 68fa7ae71e209131cea85cf0 | | DeCLIP | 16.99 | Not recorded | 68fa7ae71e209131cea85cf0 | ### RCML MRR: 35.96. Result ID: 6a02e0e747f34ce924e58d96. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TT"}. This record does not assert independent reproduction. ### RCML MRR: 35.69. Result ID: 6a02e0e747f34ce924e58d9a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"AVG"}. This record does not assert independent reproduction. ### RCML MRR: 34.02. Result ID: 6a02e0e747f34ce924e58d99. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"IT"}. This record does not assert independent reproduction. ### RCML MRR: 30.66. Result ID: 6a02e0e747f34ce924e58d98. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TI"}. This record does not assert independent reproduction. ### RCML MRR: 28.92. Result ID: 6a02e0e747f34ce924e58d97. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"II"}. This record does not assert independent reproduction. ### ImageBind MRR: 28.6. Result ID: 6a02e0e747f34ce924e58d95. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"AVG"}. This record does not assert independent reproduction. ### ImageBind MRR: 28.46. Result ID: 6a02e0e747f34ce924e58d91. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"TT"}. This record does not assert independent reproduction. ### ImageBind MRR: 26.82. Result ID: 6a02e0e747f34ce924e58d93. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"TI"}. This record does not assert independent reproduction. ### CLIP MRR: 26.72. Result ID: 6a02e0e747f34ce924e58d7d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"TT"}. This record does not assert independent reproduction. ### SigLIP MRR: 26.72. Result ID: 6a02e0e747f34ce924e58d8c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TT"}. This record does not assert independent reproduction. ### ImageBind MRR: 26.49. Result ID: 6a02e0e747f34ce924e58d94. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"IT"}. This record does not assert independent reproduction. ### ImageBind MRR: 26.4. Result ID: 6a02e0e747f34ce924e58d92. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"II"}. This record does not assert independent reproduction. ### CLIP MRR: 26.22. Result ID: 6a02e0e747f34ce924e58d81. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"AVG"}. This record does not assert independent reproduction. ### SigLIP MRR: 26.22. Result ID: 6a02e0e747f34ce924e58d90. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"AVG"}. This record does not assert independent reproduction. ### UniCL MRR: 24.4. Result ID: 6a02e0e747f34ce924e58d88. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"II"}. This record does not assert independent reproduction. ### CLIP MRR: 24.09. Result ID: 6a02e0e747f34ce924e58d80. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"IT"}. This record does not assert independent reproduction. ### SigLIP MRR: 24.09. Result ID: 6a02e0e747f34ce924e58d8f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"IT"}. This record does not assert independent reproduction. ### UniCL MRR: 23.82. Result ID: 6a02e0e747f34ce924e58d8b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"AVG"}. This record does not assert independent reproduction. ### CLIP MRR: 23.62. Result ID: 6a02e0e747f34ce924e58d7f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"TI"}. This record does not assert independent reproduction. ### SigLIP MRR: 23.62. Result ID: 6a02e0e747f34ce924e58d8e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TI"}. This record does not assert independent reproduction. ### CLIP MRR: 22.56. Result ID: 6a02e0e747f34ce924e58d7e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Similarity Measure":"II"}. This record does not assert independent reproduction. ### SigLIP MRR: 22.56. Result ID: 6a02e0e747f34ce924e58d8d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"II"}. This record does not assert independent reproduction. ### DeCLIP MRR: 21.11. Result ID: 6a02e0e747f34ce924e58d82. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TT"}. This record does not assert independent reproduction. ### DeCLIP MRR: 20.85. Result ID: 6a02e0e747f34ce924e58d86. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"AVG"}. This record does not assert independent reproduction. ### UniCL MRR: 18.53. Result ID: 6a02e0e747f34ce924e58d87. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TT"}. This record does not assert independent reproduction. ### DeCLIP MRR: 18.11. Result ID: 6a02e0e747f34ce924e58d83. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"II"}. This record does not assert independent reproduction. ### UniCL MRR: 17.27. Result ID: 6a02e0e747f34ce924e58d8a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"IT"}. This record does not assert independent reproduction. ### UniCL MRR: 17.06. Result ID: 6a02e0e747f34ce924e58d89. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TI"}. This record does not assert independent reproduction. ### DeCLIP MRR: 17.02. Result ID: 6a02e0e747f34ce924e58d84. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"TI"}. This record does not assert independent reproduction. ### DeCLIP MRR: 16.99. Result ID: 6a02e0e747f34ce924e58d85. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Similarity Measure":"IT"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.