OmniBenchmark
Benchmarks
TaskDatasetSOTA resultTrendResults
OmniBenchmark B0 Inc30
85.44Last Accuracy
28
OmniBenchmark
79.9Avg Accuracy
17
OmniBenchmark Task 4, 40-20
72.75Accuracy R
16
OmniBenchmark Task 3, 60-20
67.62Accuracy (r)
16
OmniBenchmark Task 2 80-20
66.23Accuracy (r)
16
OmniBenchmark Task 1, 100-20
63.93Accuracy (r)
16
OmniBenchmark CIL, T=10 (test)
79.9Avg Acc
11
OmniBenchmark (OB) 10 Tasks
87.33AN (Avg Novelty/Accuracy)
9
OmniBenchmark Inc-10 B-0 (test)
8.69Average F-Score
7
OmniBenchmark Inc-5 B-0 (test)
9.29Favg
7
OmniBenchmark 10 steps (incremental)
83.29Average Accuracy
7
OmniBenchmark B-0
82.27Last Accuracy (Alast)
4