FinQA
Benchmarks
TaskDatasetSOTA resultTrendResults
FinQA
77.6Accuracy
69
FinQA (test)
76.05Accuracy
57
FinQA (test)
91.16Execution Accuracy
33
FinQA
83.46Accuracy
30
FinQA (test)
76.9Precision@1
28
FinQA (test)
84.66Execution Accuracy
27
FinQA
69.4Accuracy
18
FinQA
39.7Pass@1
16
FinQA (test)
29.67Token Accuracy
16
FinQA (test)
3.97Token Perplexity
16
FinQA 1.0 (test)
91.16Execution Accuracy
14
FinQA (dev)
84.71Execution Accuracy
13
FinQA
13P@13
12
FinQA
98Recall@10
12
FinQA-TAS
76.9F1 Score
12
FinQA
4.8PC
12
FinQA
66.8EM
10
FinQA (val)
0.612Execution Accuracy
10
FinQA
86.1Accuracy
9
FinQA (test)
76.81Execution Accuracy
9
FinQA
59.37Prog Acc
9
FinQA
33.7Agreement (%)
8
FINQA
72.2Accuracy
7
FinQA
47.1RSR@5
7
FinQA
99.8RSR@5
7