Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

OpenEQA dataset and benchmarks · SOTA2 Research

Research Datasets

OpenEQA

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Embodied Question Answering

OpenEQA v1.0 (test)

67.7LLM-Match

32

Episodic-memory Question Answering

OpenEQA v1 (ScanNet)

87.7LLM-Match

29

Embodied Question Answering

OpenEQA

69.3Accuracy

26

Embodied Question Answering

OpenEQA EM-EQA

86.8Accuracy

24

Open-ended Video Reasoning

OpenEQA (test)

58.6Accuracy (< 30s)

18

3D Question Answering

OpenEQA

56.2LLM-Match

12

Active Question Answering

OpenEQA v1 (HM3D)

85.1LLM-Match

12

Episodic-memory Question Answering

OpenEQA v1 (HM3D)

85.1LLM Match Score

12

Embodied Question Answering

OpenEQA EM-EQA Episodes up to 32 frames

86.8LLM-Match Score

10

Zero-shot understanding of embodied scenes

OpenEQA

51.2Score

10

Embodied Question Answering

OpenEQA (test)

86.8GPT-4 Score

10

Embodied Question Answering

OpenEQA EM-EQA

86.8LLM-Match

8

Episodic Memory Embodied Question Answering

OpenEQA 1/10 subset Unseen (val)

61.5LLM Match Score

7

Embodied Question Answering

OpenEQA v1 (test)

85.1Score

5

Active Embodied Question Answering

OpenEQA 184

52.6LLM-SR

4

Popular tasks

Embodied Question Answering Episodic-memory Question Answering 3D Question Answering Zero-shot understanding of embodied scenes Active Question Answering

Follow for updates

Join SOTA2 Contact