Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Robot Task Planning research benchmarks · SOTA2 Research

Robot Task Planning

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

REI-Bench Implicit REs

LLaMA3.1-8B + TOCC

40.1Object Omission Rate

6

Mar 12, 2026

REI-Bench Mixed REs

LLaMA3.1-8B + TOCC

28.5Object Omission Rate

6

Mar 12, 2026

REI-Bench Explicit REs

LLaMA3.1-8B + TOCC

0.168Object Omission Rate

6

Mar 12, 2026

Ref. Image Instruction Kitchen

55Success Rate

4

Apr 20, 2026

Language Instruction

73Success Rate

4

Apr 20, 2026

65Success Rate

4

Apr 20, 2026

Overall Combined Tasks

99Token Cost (k)

4

Feb 26, 2026

Bridge Building

50Token Cost (k)

4

Feb 26, 2026

36Token Cost (k)

4

Feb 26, 2026

212Token Cost (k)

4

Feb 26, 2026

72Success Rate

3

Apr 20, 2026

Ref. Image Instruction Blocks

86Success Rate

3

Apr 20, 2026

AI2-THOR Complex tasks

RecipeMasterLLM

78.1Success Rate

2

Feb 26, 2026

AI2-THOR Compound tasks

RecipeMasterLLM

74.5Success Rate

2

Feb 26, 2026

AI2-THOR Simple tasks

RecipeMasterLLM

87.1Success Rate

2

Feb 26, 2026

AI2-THOR Elemental tasks

100Success Rate

2

Feb 26, 2026

Complex Polyculture Environment Multiple Plant - Multiple Target Table II

1Success Rate

2

Feb 26, 2026

Complex Polyculture Environment Multiple Plant - Single Target Table II

100Success Rate

2

Feb 26, 2026

Complex Polyculture Environment Single Plant - Multiple Target Table II

1Success Rate

2

Feb 26, 2026

Complex Polyculture Environment Table II (Single Plant - Single Target)

100Success Rate

2

Feb 26, 2026

Popular datasets

AI2-THOR Complex Polyculture Environment REI-Bench Ref. Image Instruction Overall

Follow for updates

Join SOTA2 Contact