TallyQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
TallyQA
82.2Accuracy
67
TallyQA
94.09Accuracy
49
TallyQA (test)
86.2Simple Accuracy
14
TallyQA complex
77.1Accuracy
13
TallyQA (test)
86.2Simple Accuracy
12
TallyQA simple
86.3Accuracy
10
TallyQA Simple
86.3Accuracy
9
TallyQA Complex 1.0 (test)
56.2Accuracy (ACC)
9
TallyQA Simple 1.0 (test)
71.8Accuracy
9
TallyQA (ZOOM-Hard)
16.78GPT Accuracy
6
TallyQA ZOOM-Medium
24.35GPT Accuracy
6
TallyQA ZOOM-Easy
51.27GPT Accuracy
6
TallyQA (val)
66Accuracy
6
TallyQA
35Score
5
TallyQA Complex
77.1Accuracy
4
TallyQA simple
86Exact Match
3