Spawrious
Benchmarks
TaskDatasetSOTA resultTrendResults
Spawrious M2M-Hard
92.4Accuracy (M2M-Hard)
47
Spawrious O2O-Hard
95.7Accuracy
47
Spawrious
80.8Accuracy
28
Spawrious M2M-Medium
75.9Accuracy
19
Spawrious M2M-Easy
92.9Accuracy (M2M-Easy)
19
Spawrious O2O-Medium
62.9Accuracy
19
Spawrious O2O-Easy
94.2Accuracy
19
Spawrious (test)
95.8O2O Accuracy (Easy)
15
Spawrious M2M
94Accuracy
13
Spawrious O2O
95.7Accuracy
13
Spawrious M2M
85.4WGA
13
Spawrious O2O
89.9WGA
13
Spawrious M2M (Hard)
82.24Average Accuracy (AA)
12
Spawrious O2O (Easy)
95.13AA
12
Spawrious many-to-many hard (test)
79.9WGA
11
Spawrious many-to-many medium (test)
87.2WGA
11
Spawrious many-to-many easy (test)
92.6WGA
11
Spawrious one-to-one hard (test)
81.4WGA
11
Spawrious one-to-one medium (test)
90.3WGA
11
Spawrious one-to-one easy (test)
93.3WGA
11
Spawrious (test)
72.4Accuracy
10
Spawrious M2M-Hard (test)
73.9Worst-Group Accuracy
6