# Navigation on Scene 2 Suite main room

Source: [Navigation on Scene 2 Suite main room](<https://www.sota2.com/research/sota/navigation-on-scene-2-suite-main-room>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:03:17.935Z

Evaluation of agent navigation performance within the Scene 2 Suite main room environment, measured by SRnav, StepComp, SPL, and NE\[m\].

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Navigation |
| Dataset (including any stated split) | Scene 2 Suite main room |
| Metric | SRnav |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [SRnav](<https://www.sota2.com/research/sota/navigation-on-scene-2-suite-main-room.md?metric=SRnav>): Higher is better; unit: SCALAR.

- [StepComp](<https://www.sota2.com/research/sota/navigation-on-scene-2-suite-main-room.md?metric=StepComp>): Higher is better; unit: SCALAR.

- [SPL](<https://www.sota2.com/research/sota/navigation-on-scene-2-suite-main-room.md?metric=SPL>): Higher is better; unit: SCALAR.

- [NE (m)](<https://www.sota2.com/research/sota/navigation-on-scene-2-suite-main-room.md?metric=NE%20(m)>): Lower is better; unit: OTHER.

## Recorded results

| Method | SRnav | Result date | Report paper |
| --- | --- | --- | --- |
| SpatialMem | 0.8 | Not recorded | 6971af2de25ad2fa9d1edabf |
| internvl | 0.79 | Not recorded | 6971af2de25ad2fa9d1edabf |
| gemini | 0.78 | Not recorded | 6971af2de25ad2fa9d1edabf |
| llava | 0.72 | Not recorded | 6971af2de25ad2fa9d1edabf |
| openai | 0.72 | Not recorded | 6971af2de25ad2fa9d1edabf |
| internvl | 0.7 | Not recorded | 6971af2de25ad2fa9d1edabf |
| together | 0.65 | Not recorded | 6971af2de25ad2fa9d1edabf |
| qwen25vl | 0.54 | Not recorded | 6971af2de25ad2fa9d1edabf |

### SpatialMem

SRnav: 0.8. Result ID: 69979f325698665ec4f52f3e.

[Reporting paper](<https://www.sota2.com/research/paper/6971af2de25ad2fa9d1edabf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6971af2de25ad2fa9d1edabf.md>)

Recorded evaluation configuration: {"Model":"SpatialMem (Our Model)"}. This record does not assert independent reproduction.

### internvl

SRnav: 0.79. Result ID: 69979f325698665ec4f52f38.

[Reporting paper](<https://www.sota2.com/research/paper/6971af2de25ad2fa9d1edabf.md>)

Recorded evaluation configuration: {"Model":"InternVL 2.5","Deployment":"Local","Entry":"1"}. This record does not assert independent reproduction.

### gemini

SRnav: 0.78. Result ID: 69979f325698665ec4f52f37.

[Reporting paper](<https://www.sota2.com/research/paper/6971af2de25ad2fa9d1edabf.md>)

Recorded evaluation configuration: {"Model":"Google Gemini"}. This record does not assert independent reproduction.

### llava

SRnav: 0.72. Result ID: 69979f325698665ec4f52f39.

[Reporting paper](<https://www.sota2.com/research/paper/6971af2de25ad2fa9d1edabf.md>)

Recorded evaluation configuration: {"Model":"LLaVA-Video","Deployment":"Local"}. This record does not assert independent reproduction.

### openai

SRnav: 0.72. Result ID: 69979f325698665ec4f52f3b.

[Reporting paper](<https://www.sota2.com/research/paper/6971af2de25ad2fa9d1edabf.md>)

Recorded evaluation configuration: {"Model":"OpenAI GPT-4o"}. This record does not assert independent reproduction.

### internvl

SRnav: 0.7. Result ID: 69979f325698665ec4f52f3a.

[Reporting paper](<https://www.sota2.com/research/paper/6971af2de25ad2fa9d1edabf.md>)

Recorded evaluation configuration: {"Model":"InternVL 2.5","Deployment":"Local","Entry":"2"}. This record does not assert independent reproduction.

### together

SRnav: 0.65. Result ID: 69979f325698665ec4f52f3c.

[Reporting paper](<https://www.sota2.com/research/paper/6971af2de25ad2fa9d1edabf.md>)

Recorded evaluation configuration: {"Model":"Qwen2.5-VL","Deployment":"Cloud"}. This record does not assert independent reproduction.

### qwen25vl

SRnav: 0.54. Result ID: 69979f325698665ec4f52f3d.

[Reporting paper](<https://www.sota2.com/research/paper/6971af2de25ad2fa9d1edabf.md>)

Recorded evaluation configuration: {"Model":"Qwen2.5-VL","Deployment":"Local"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.