# Ontology Grounding on Pixar Kitchen Set abbreviated regime SOMA-HOME ontology (test)

Source: [Ontology Grounding on Pixar Kitchen Set abbreviated regime SOMA-HOME ontology (test)](<https://www.sota2.com/research/sota/ontology-grounding-on-pixar-kitchen-set-abbreviated-regime-soma-home-ontology-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-09T10:24:14.307Z

Evaluation of Ontology Grounding performance on the test split of the Pixar Kitchen Set abbreviated regime SOMA-HOME ontology dataset, measured using EMA and HF1.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Ontology Grounding |
| Dataset (including any stated split) | Pixar Kitchen Set abbreviated regime SOMA-HOME ontology (test) |
| Metric | EMA |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [EMA](<https://www.sota2.com/research/sota/ontology-grounding-on-pixar-kitchen-set-abbreviated-regime-soma-home-ontology-test.md?metric=EMA>): Higher is better; unit: PERCENT.

- [HF1](<https://www.sota2.com/research/sota/ontology-grounding-on-pixar-kitchen-set-abbreviated-regime-soma-home-ontology-test.md?metric=HF1>): Higher is better; unit: PERCENT.

## Recorded results

| Method | EMA | Result date | Report paper |
| --- | --- | --- | --- |
| Gemini 3 Flash | 89 | Not recorded | 6a279e5390966ade919bf9b0 |
| Gemini 2.5 Flash | 84 | Not recorded | 6a279e5390966ade919bf9b0 |
| Gemini 3 Flash | 83 | Not recorded | 6a279e5390966ade919bf9b0 |
| Gemini 3 Flash | 80 | Not recorded | 6a279e5390966ade919bf9b0 |
| Gemini 2.5 Flash | 77 | Not recorded | 6a279e5390966ade919bf9b0 |
| Gemini 2.5 Flash | 76 | Not recorded | 6a279e5390966ade919bf9b0 |
| Qwen 3.5-27B | 75 | Not recorded | 6a279e5390966ade919bf9b0 |
| Qwen 3.5-27B | 73 | Not recorded | 6a279e5390966ade919bf9b0 |
| Qwen 3.5-27B | 69 | Not recorded | 6a279e5390966ade919bf9b0 |
| Qwen 3.5-27B | 67 | Not recorded | 6a279e5390966ade919bf9b0 |
| Qwen 3.5-27B | 54 | Not recorded | 6a279e5390966ade919bf9b0 |
| Qwen 3.5-27B | 49 | Not recorded | 6a279e5390966ade919bf9b0 |
| S-BERT | 14 | Not recorded | 6a279e5390966ade919bf9b0 |
| LV-NN | 2 | Not recorded | 6a279e5390966ade919bf9b0 |
| Multiverse | 0 | Not recorded | 6a279e5390966ade919bf9b0 |

### Gemini 3 Flash

EMA: 89. Result ID: 6a27e937fbc373592c25527d.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Prompting Strategy":"B"}. This record does not assert independent reproduction.

### Gemini 2.5 Flash

EMA: 84. Result ID: 6a27e937fbc373592c255279.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Prompting Strategy":"A"}. This record does not assert independent reproduction.

### Gemini 3 Flash

EMA: 83. Result ID: 6a27e937fbc373592c25527e.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Prompting Strategy":"C"}. This record does not assert independent reproduction.

### Gemini 3 Flash

EMA: 80. Result ID: 6a27e937fbc373592c25527c.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Prompting Strategy":"A"}. This record does not assert independent reproduction.

### Gemini 2.5 Flash

EMA: 77. Result ID: 6a27e937fbc373592c25527a.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Prompting Strategy":"B"}. This record does not assert independent reproduction.

### Gemini 2.5 Flash

EMA: 76. Result ID: 6a27e937fbc373592c25527b.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Prompting Strategy":"C"}. This record does not assert independent reproduction.

### Qwen 3.5-27B

EMA: 75. Result ID: 6a27e937fbc373592c255282.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Model Mode":"thinking","Prompting Strategy":"A"}. This record does not assert independent reproduction.

### Qwen 3.5-27B

EMA: 73. Result ID: 6a27e937fbc373592c255284.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Model Mode":"thinking","Prompting Strategy":"C"}. This record does not assert independent reproduction.

### Qwen 3.5-27B

EMA: 69. Result ID: 6a27e937fbc373592c255283.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Model Mode":"thinking","Prompting Strategy":"B"}. This record does not assert independent reproduction.

### Qwen 3.5-27B

EMA: 67. Result ID: 6a27e937fbc373592c25527f.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Model Mode":"instruct","Prompting Strategy":"A"}. This record does not assert independent reproduction.

### Qwen 3.5-27B

EMA: 54. Result ID: 6a27e937fbc373592c255280.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Model Mode":"instruct","Prompting Strategy":"B"}. This record does not assert independent reproduction.

### Qwen 3.5-27B

EMA: 49. Result ID: 6a27e937fbc373592c255281.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"Model Mode":"instruct","Prompting Strategy":"C"}. This record does not assert independent reproduction.

### S-BERT

EMA: 14. Result ID: 6a27e937fbc373592c255278.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66441e209131cea0f5ab.md>)

[Implementation](<https://github.com/UKPLab/sentence-transformers>)

Recorded evaluation configuration: {"type":"Cosine Similarity","model":"all-MiniLM-L6-v2"}. This record does not assert independent reproduction.

### LV-NN

EMA: 2. Result ID: 6a27e937fbc373592c255277.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

Recorded evaluation configuration: {"type":"Log-Volume Nearest Neighbor"}. This record does not assert independent reproduction.

### Multiverse

EMA: 0. Result ID: 6a27e937fbc373592c255276.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e5390966ade919bf9b0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed23.md>)

Recorded evaluation configuration: {"type":"Dictionary Mapping"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
