# Ontology Grounding on Pixar Kitchen Set semantic regime SOMA-HOME ontology (test)

Source: [Ontology Grounding on Pixar Kitchen Set semantic regime SOMA-HOME ontology (test)](<https://www.sota2.com/research/sota/ontology-grounding-on-pixar-kitchen-set-semantic-regime-soma-home-ontology-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-09T10:24:14.238Z

Evaluation of Ontology Grounding performance on the test split of the Pixar Kitchen Set dataset, using the SOMA-HOME ontology regime, reporting EMA and HF1 scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Ontology Grounding |
| Dataset (including any stated split) | Pixar Kitchen Set semantic regime SOMA-HOME ontology (test) |
| Metric | EMA |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [EMA](<https://www.sota2.com/research/sota/ontology-grounding-on-pixar-kitchen-set-semantic-regime-soma-home-ontology-test.md?metric=EMA>): Higher is better; unit: PERCENT.

- [HF1](<https://www.sota2.com/research/sota/ontology-grounding-on-pixar-kitchen-set-semantic-regime-soma-home-ontology-test.md?metric=HF1>): Higher is better; unit: PERCENT.

## Recorded results

| Method | EMA | Result date | Report paper |
| --- | --- | --- | --- |
| Gemini 2.5 Flash | 96 | Not recorded | 6a279e5390966ade919bf9b0 |
| Gemini 2.5 Flash | 94 | Not recorded | 6a279e5390966ade919bf9b0 |
| Gemini 2.5 Flash | 94 | Not recorded | 6a279e5390966ade919bf9b0 |
| Gemini 3 Flash | 94 | Not recorded | 6a279e5390966ade919bf9b0 |
| Gemini 3 Flash | 94 | Not recorded | 6a279e5390966ade919bf9b0 |
| Qwen 3.5-27B | 94 | Not recorded | 6a279e5390966ade919bf9b0 |
| Qwen 3.5-27B | 94 | Not recorded | 6a279e5390966ade919bf9b0 |
| Qwen 3.5-27B | 94 | Not recorded | 6a279e5390966ade919bf9b0 |
| Gemini 3 Flash | 92 | Not recorded | 6a279e5390966ade919bf9b0 |
| Qwen 3.5-27B | 90 | Not recorded | 6a279e5390966ade919bf9b0 |
| Qwen 3.5-27B | 90 | Not recorded | 6a279e5390966ade919bf9b0 |
| Qwen 3.5-27B | 90 | Not recorded | 6a279e5390966ade919bf9b0 |
| S-BERT | 67 | Not recorded | 6a279e5390966ade919bf9b0 |
| Multiverse | 9 | Not recorded | 6a279e5390966ade919bf9b0 |
| LV-NN | 2 | Not recorded | 6a279e5390966ade919bf9b0 |

### Gemini 2.5 Flash

EMA: 96. Result ID: 6a27e937fbc373592c25526a.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Prompting Strategy":"A"}. This record does not assert independent reproduction.

### Gemini 2.5 Flash

EMA: 94. Result ID: 6a27e937fbc373592c25526b.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Prompting Strategy":"B"}. This record does not assert independent reproduction.

### Gemini 2.5 Flash

EMA: 94. Result ID: 6a27e937fbc373592c25526c.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Prompting Strategy":"C"}. This record does not assert independent reproduction.

### Gemini 3 Flash

EMA: 94. Result ID: 6a27e937fbc373592c25526d.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Prompting Strategy":"A"}. This record does not assert independent reproduction.

### Gemini 3 Flash

EMA: 94. Result ID: 6a27e937fbc373592c25526f.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Prompting Strategy":"C"}. This record does not assert independent reproduction.

### Qwen 3.5-27B

EMA: 94. Result ID: 6a27e937fbc373592c255270.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Model Mode":"instruct","Prompting Strategy":"A"}. This record does not assert independent reproduction.

### Qwen 3.5-27B

EMA: 94. Result ID: 6a27e937fbc373592c255273.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Model Mode":"thinking","Prompting Strategy":"A"}. This record does not assert independent reproduction.

### Qwen 3.5-27B

EMA: 94. Result ID: 6a27e937fbc373592c255274.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Model Mode":"thinking","Prompting Strategy":"B"}. This record does not assert independent reproduction.

### Gemini 3 Flash

EMA: 92. Result ID: 6a27e937fbc373592c25526e.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Prompting Strategy":"B"}. This record does not assert independent reproduction.

### Qwen 3.5-27B

EMA: 90. Result ID: 6a27e937fbc373592c255271.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Model Mode":"instruct","Prompting Strategy":"B"}. This record does not assert independent reproduction.

### Qwen 3.5-27B

EMA: 90. Result ID: 6a27e937fbc373592c255272.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Model Mode":"instruct","Prompting Strategy":"C"}. This record does not assert independent reproduction.

### Qwen 3.5-27B

EMA: 90. Result ID: 6a27e937fbc373592c255275.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Model Mode":"thinking","Prompting Strategy":"C"}. This record does not assert independent reproduction.

### S-BERT

EMA: 67. Result ID: 6a27e937fbc373592c255269.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66441e209131cea0f5ab.md>)

[Implementation](<https://github.com/UKPLab/sentence-transformers>)

Recorded evaluation configuration: {"type":"Cosine Similarity","model":"all-MiniLM-L6-v2"}. This record does not assert independent reproduction.

### Multiverse

EMA: 9. Result ID: 6a27e937fbc373592c255267.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed23.md>)

Recorded evaluation configuration: {"type":"Dictionary Mapping"}. This record does not assert independent reproduction.

### LV-NN

EMA: 2. Result ID: 6a27e937fbc373592c255268.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"type":"Log-Volume Nearest Neighbor"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
