MATERIAL
Benchmarks
TaskDatasetSOTA resultTrendResults
MATERIAL Tagalog 1.0 (dev)
59MAP
16
MATERIAL Tagalog 1.0 (Analysis)
61.1MAP
16
Material
81.5Accuracy
10
MATERIAL Swahili (eval)
22.7MAP (Text)
9
MATERIAL Swahili (dev)
40.3MAP (Text)
9
MATERIAL Swahili (Analysis)
48.3MAP (Text)
9
MATERIAL Somali (Eval)
13.1MAP (Text)
9
MATERIAL Somali (dev)
29.5MAP (Text)
9
MATERIAL Somali (Analysis)
35.4MAP (Text)
9
Material (test)
80.36Global Accuracy
4