OmniBench
Benchmarks
TaskDatasetSOTA resultTrendResults
Omnibench
47.6Accuracy
34
OmniBench
63.6Accuracy
16
OmniBench Walk (Slow)
100Success Rate (SR)
14
OmniBench Low 1.0 (test)
100Success Rate (SR)
14
OmniBench Medium 1.0 (test)
100Success Rate (SR)
14
OmniBench High 1.0 (test)
100Success Rate (SR)
14
OmniBench (test)
43.6Score
12
OmniBench
42.47Accuracy
12
OmniBench (held-out)
55.2Causal Score
11
OmniBench
49.1Score
10
OmniBench
54.9Causal Score
9
OmniBench
58.41Overall Score
8
OmniBench Jump (Low)
100Success Rate
7
OmniBench Jump Medium
100Success Rate
7
OmniBench Jump (High)
90Success Rate (SR)
7
OmniBench Run Medium
100Success Rate (SR)
7
OmniBench Run (Fast)
100Success Rate (SR)
7
OmniBench Walk (Fast)
100Success Rate
7
OmniBench Low 1.0 (test)
100Success Rate (SR)
7
OmniBench Medium 1.0 (test)
100SR
7
OmniBench High 1.0 (test)
100Success Rate (SR)
7
OmniBench
48.25Accuracy
6
OmniBench
56.7Accuracy
5
OmniBench
—Primary metric
0