TheoremQA
Benchmarks
TaskDatasetSOTA resultTrendResults
TheoremQA
82.49Accuracy
68
TheoremQA
51.2Accuracy
67
TheoremQA
53Score
34
TheoremQA
0.873AUROC
32
TheoremQA
68.04Accuracy
31
TheoremQA
58.8Accuracy
28
TheoremQA (test)
48.4Accuracy
28
TheoremQA Tier-1 (first-20 sweep)
54Targeted Error Rate
27
TheoremQA
76.2Correctness
25
TheoremQA
41.02Pass@1 Accuracy
18
TheoremQA
24.7Pass@1
18
TheoremQA
34.1Pass@1
18
TheoremQA
55.4Avg@2
16
TheoremQA
15Accuracy
16
TheoremQA
57.88ThmQA Score
15
TheoremQA
88.87AUROC
14
TheoremQA
86.32Accuracy
13
TheoremQA
13.5Accuracy
13
TheoremQA
4.4Acceptance Length
12
TheoremQA TQ-Math
57.7Exact Match Accuracy
12
TheoremQA
66.3Accuracy
12
TheoremQA standard (test)
56Accuracy
12
TheoremQA
77.4nDCG@1
11
TheoremQA
67.75Pass@1
10
TheoremQA
55.38Accuracy
10