# Episodic Memory Question Answering (Top-down map) on Matterport3D

Source: [Episodic Memory Question Answering (Top-down map) on Matterport3D](<https://www.sota2.com/research/sota/episodic-memory-question-answering-top-down-map-on-matterport3d>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:47:19.774Z

Evaluation of Episodic Memory Question Answering performance on the Matterport3D dataset, focusing on spatial metrics derived from top-down map predictions, including IoU, Recall, and Precision.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Episodic Memory Question Answering (Top-down map) |
| Dataset (including any stated split) | Matterport3D |
| Metric | IoU |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [IoU](<https://www.sota2.com/research/sota/episodic-memory-question-answering-top-down-map-on-matterport3d.md?metric=IoU>): Higher is better; unit: PERCENT.

- [Recall](<https://www.sota2.com/research/sota/episodic-memory-question-answering-top-down-map-on-matterport3d.md?metric=Recall>): Higher is better; unit: PERCENT.

- [Precision](<https://www.sota2.com/research/sota/episodic-memory-question-answering-top-down-map-on-matterport3d.md?metric=Precision>): Higher is better; unit: PERCENT.

## Recorded results

| Method | IoU | Result date | Report paper |
| --- | --- | --- | --- |
| EMQA agent | 29.11 | Not recorded | 68fa6c7e1e209131cea344ed |
| EMQA agent | 27.42 | Not recorded | 68fa6c7e1e209131cea344ed |
| SMNetDecoder | 26.92 | Not recorded | 68fa6c7e1e209131cea344ed |
| EgoSemSeg | 22.89 | Not recorded | 68fa6c7e1e209131cea344ed |
| LangOnly | 4.75 | Not recorded | 68fa6c7e1e209131cea344ed |
| EgoBuffer-Attn | 0.12 | Not recorded | 68fa6c7e1e209131cea344ed |
| EgoBuffer-Avg | 0.07 | Not recorded | 68fa6c7e1e209131cea344ed |
| EgoBuffer-GRU | 0.01 | Not recorded | 68fa6c7e1e209131cea344ed |

### EMQA agent

IoU: 29.11. Result ID: 698f1b103a6c314849f5dd13.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7e1e209131cea344ed.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c7e1e209131cea344ed.md>)

[Implementation](<https://samyak-268.github.io/emqa/>)

Recorded evaluation configuration: {"temporal\_features":true}. This record does not assert independent reproduction.

### EMQA agent

IoU: 27.42. Result ID: 698f1b103a6c314849f5dd12.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7e1e209131cea344ed.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c7e1e209131cea344ed.md>)

[Implementation](<https://samyak-268.github.io/emqa/>)

Recorded evaluation configuration: {"temporal\_features":false}. This record does not assert independent reproduction.

### SMNetDecoder

IoU: 26.92. Result ID: 698f1b103a6c314849f5dd0e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7e1e209131cea344ed.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa697f1e209131cea2276c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### EgoSemSeg

IoU: 22.89. Result ID: 698f1b103a6c314849f5dd0d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7e1e209131cea344ed.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LangOnly

IoU: 4.75. Result ID: 698f1b103a6c314849f5dd0c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7e1e209131cea344ed.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d81e209131cea013ba.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### EgoBuffer-Attn

IoU: 0.12. Result ID: 698f1b103a6c314849f5dd11.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7e1e209131cea344ed.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa656e1e209131cea0a550.md>)

Recorded evaluation configuration: {"mechanism":"attention"}. This record does not assert independent reproduction.

### EgoBuffer-Avg

IoU: 0.07. Result ID: 698f1b103a6c314849f5dd0f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7e1e209131cea344ed.md>)

Recorded evaluation configuration: {"pooling":"average"}. This record does not assert independent reproduction.

### EgoBuffer-GRU

IoU: 0.01. Result ID: 698f1b103a6c314849f5dd10.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7e1e209131cea344ed.md>)

Recorded evaluation configuration: {"recurrent\_unit":"GRU"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.