# Open-Vocabulary Object Retrieval on HM3DSem 25

Source: [Open-Vocabulary Object Retrieval on HM3DSem 25](<https://www.sota2.com/research/sota/open-vocabulary-object-retrieval-on-hm3dsem-25>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:34:38.569Z

Evaluation of Open-Vocabulary Object Retrieval performance on the HM3DSem 25 dataset, measured using rank-based accuracy metrics (Acc@K) and AUC.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Open-Vocabulary Object Retrieval |
| Dataset (including any stated split) | HM3DSem 25 |
| Metric | Accuracy@5 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 3 of 3 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy@5](<https://www.sota2.com/research/sota/open-vocabulary-object-retrieval-on-hm3dsem-25.md?metric=Accuracy%405>): Higher is better; unit: PERCENT.

- [Accuracy@10](<https://www.sota2.com/research/sota/open-vocabulary-object-retrieval-on-hm3dsem-25.md?metric=Accuracy%4010>): Higher is better; unit: PERCENT.

- [Accuracy@25](<https://www.sota2.com/research/sota/open-vocabulary-object-retrieval-on-hm3dsem-25.md?metric=Accuracy%4025>): Higher is better; unit: PERCENT.

- [Accuracy@100](<https://www.sota2.com/research/sota/open-vocabulary-object-retrieval-on-hm3dsem-25.md?metric=Accuracy%40100>): Higher is better; unit: PERCENT.

- [Accuracy@250](<https://www.sota2.com/research/sota/open-vocabulary-object-retrieval-on-hm3dsem-25.md?metric=Accuracy%40250>): Higher is better; unit: PERCENT.

- [Accuracy@500](<https://www.sota2.com/research/sota/open-vocabulary-object-retrieval-on-hm3dsem-25.md?metric=Accuracy%40500>): Higher is better; unit: PERCENT.

- [AUC (Accuracy)](<https://www.sota2.com/research/sota/open-vocabulary-object-retrieval-on-hm3dsem-25.md?metric=AUC%20(Accuracy)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy@5 | Result date | Report paper |
| --- | --- | --- | --- |
| REASONINGGRAPH | 37.72 | Not recorded | 69818202a8b01e76cc8e2a15 |
| ConceptGraphs | 18.5 | Not recorded | 69818202a8b01e76cc8e2a15 |
| HOV-SG | 16.09 | Not recorded | 69818202a8b01e76cc8e2a15 |

### REASONINGGRAPH

Accuracy@5: 37.72. Result ID: 6999c9015698665ec4462a2e.

[Reporting paper](<https://www.sota2.com/research/paper/69818202a8b01e76cc8e2a15.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69818202a8b01e76cc8e2a15.md>)

Recorded evaluation configuration: {"#objects":"88.33"}. This record does not assert independent reproduction.

### ConceptGraphs

Accuracy@5: 18.5. Result ID: 6999c9015698665ec4462a2c.

[Reporting paper](<https://www.sota2.com/research/paper/69818202a8b01e76cc8e2a15.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70b91e209131cea4cdcf.md>)

Recorded evaluation configuration: {"#objects":"237.78"}. This record does not assert independent reproduction.

### HOV-SG

Accuracy@5: 16.09. Result ID: 6999c9015698665ec4462a2d.

[Reporting paper](<https://www.sota2.com/research/paper/69818202a8b01e76cc8e2a15.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74f71e209131cea64e5a.md>)

Recorded evaluation configuration: {"#objects":"405.33"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.