Digit-Five
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Digit-Five (test)
92.97Average Accuracy
60
Digit-five mt → mm, sv, up, sy
86.9Accuracy
20
Digit-five up → mm, mt, sv, sy
75.5Accuracy
10
Digit-five sy → mm, mt, sv, up
0.856Accuracy
10
Digit-five sv → mm, mt, up, sy
79.7ACC
10
Digit-five mm → mt, sv, up, sy
78.5Accuracy
10
Digit-Five 200 clients (test)
89.8Test Accuracy
7
Digit-Five 100 clients (test)
91.1Accuracy
7
Digit-Five 50 clients (test)
92.7Test Accuracy
7