Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

ROPES dataset and benchmarks · SOTA2 Research

Research Datasets

ROPES

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

3D pole-striking

Ropes In-domain (Brown, Yellow, Red, Orange)

0Average Distance Error (45cm, 5g)

14

Reading Comprehension

ROPES

58.64F1 Score

14

Short-context Reading Comprehension

ROPES

77.63F1 Score

10

Refusal on Irrelevant Queries

ROPES

94.66Refusal F1

8

Question Answering

ROPES CS

45.5Score

6

Question Answering

ROPES

67Score

6

Question Answering

ROPES

0.752Accuracy

5

Popular tasks

Question Answering Reading Comprehension 3D pole-striking Refusal on Irrelevant Queries Short-context Reading Comprehension

Follow for updates

Join SOTA2 Contact