# Embodied Question Answering on NaVQA

Source: [Embodied Question Answering on NaVQA](<https://www.sota2.com/research/sota/embodied-question-answering-on-navqa>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-21T13:16:31.628Z

Evaluation of model performance on the NaVQA dataset for Embodied Question Answering, reporting Response Latency and Fallback Percentage.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Embodied Question Answering |
| Dataset (including any stated split) | NaVQA |
| Metric | Response Latency (s) |
| Unit | TIME |
| Direction | Lower is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Response Latency (s)](<https://www.sota2.com/research/sota/embodied-question-answering-on-navqa.md?metric=Response%20Latency%20(s)>): Lower is better; unit: TIME.

- [Fallback Percentage](<https://www.sota2.com/research/sota/embodied-question-answering-on-navqa.md?metric=Fallback%20Percentage>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Response Latency (s) | Result date | Report paper |
| --- | --- | --- | --- |
| Graph Memory | 9.97 | Not recorded | 69e7051d7d0172140ec7f28c |
| Graph Memory | 10.8 | Not recorded | 69e7051d7d0172140ec7f28c |
| ReMEmbR | 19.14 | Not recorded | 69e7051d7d0172140ec7f28c |
| ReMEmbR | 19.79 | Not recorded | 69e7051d7d0172140ec7f28c |
| Graph Memory + ReMEmbR | 23.13 | Not recorded | 69e7051d7d0172140ec7f28c |
| Graph Memory + ReMEmbR | 23.73 | Not recorded | 69e7051d7d0172140ec7f28c |

### Graph Memory

Response Latency (s): 9.97. Result ID: 69e7777a47f34ce924cf4d52.

[Reporting paper](<https://www.sota2.com/research/paper/69e7051d7d0172140ec7f28c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e7051d7d0172140ec7f28c.md>)

Recorded evaluation configuration: {"VLM":"Florence-2-large","Agent Configuration":"Graph Memory"}. This record does not assert independent reproduction.

### Graph Memory

Response Latency (s): 10.8. Result ID: 69e7777a47f34ce924cf4d4f.

[Reporting paper](<https://www.sota2.com/research/paper/69e7051d7d0172140ec7f28c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e7051d7d0172140ec7f28c.md>)

Recorded evaluation configuration: {"VLM":"Florence-2-base","Agent Configuration":"Graph Memory"}. This record does not assert independent reproduction.

### ReMEmbR

Response Latency (s): 19.14. Result ID: 69e7777a47f34ce924cf4d50.

[Reporting paper](<https://www.sota2.com/research/paper/69e7051d7d0172140ec7f28c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74e61e209131cea6490d.md>)

Recorded evaluation configuration: {"VLM":"Florence-2-base","Agent Configuration":"ReMEmbR"}. This record does not assert independent reproduction.

### ReMEmbR

Response Latency (s): 19.79. Result ID: 69e7777a47f34ce924cf4d53.

[Reporting paper](<https://www.sota2.com/research/paper/69e7051d7d0172140ec7f28c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74e61e209131cea6490d.md>)

Recorded evaluation configuration: {"VLM":"Florence-2-large","Agent Configuration":"ReMEmbR"}. This record does not assert independent reproduction.

### Graph Memory + ReMEmbR

Response Latency (s): 23.13. Result ID: 69e7777a47f34ce924cf4d51.

[Reporting paper](<https://www.sota2.com/research/paper/69e7051d7d0172140ec7f28c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e7051d7d0172140ec7f28c.md>)

Recorded evaluation configuration: {"VLM":"Florence-2-base","Agent Configuration":"Graph Memory + ReMEmbR"}. This record does not assert independent reproduction.

### Graph Memory + ReMEmbR

Response Latency (s): 23.73. Result ID: 69e7777a47f34ce924cf4d54.

[Reporting paper](<https://www.sota2.com/research/paper/69e7051d7d0172140ec7f28c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e7051d7d0172140ec7f28c.md>)

Recorded evaluation configuration: {"VLM":"Florence-2-large","Agent Configuration":"Graph Memory + ReMEmbR"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
