GOAT-Bench

GOAT-Bench unseen (val)

37

GOAT-Bench 1.0 (test)

32

GOAT-Bench unseen (val)

21

GOAT-Bench

21

GOAT-Bench 1/10-scale subset (val-unseen)

13

GOAT-Bench Seen (val)

13

GOAT-Bench In-Domain

11

GOAT-Bench unseen (val)

10

GOAT-Bench unseen (val)

9

GOAT-Bench

8

GOAT-Bench (Out-Of-Domain)

7

GOAT-BENCH Strict Physical Regime full 2,669-subtask (val_unseen)

6

Full GOAT-Bench Unseen (val)

6

Full GOAT-Bench Synonyms (val)

6

Full GOAT-Bench Seen (val)

6

GOAT-Bench Seen-Synonyms (val)

6

GOAT-Bench (val-seen)

4

GOAT-Bench seen (val)

4

GOAT-Bench evaluation 278 subtasks

4

GOAT-Bench full 2,780 subtasks (val)

4

GOAT-Bench unseen (val)

4

GOAT-BENCH Relaxed Continuous Regime full 2,669-subtask (val_unseen)

1