QAGS
Benchmarks
TaskDatasetSOTA resultTrendResults
QAGS-XSum
57.4Spearman Correlation
39
QAGS CNNDM
73.9Spearman Correlation
38
QAGS-XSum (test)
5.27Pearson Correlation Coefficient
35
QAGS-CNNDM (test)
78.1Pearson Correlation Coefficient
22
QAGS XSUM
53.9Pearson Correlation
19
QAGS-X
0.248Pearson Correlation
15
QAGS-C
0.73Pearson Correlation Coefficient
15
QAGS Average (test)
0.604Pearson r
13
QAGS CNN
0.735Pearson Correlation
11
QAGS-X
0.618Pearson Correlation (rp)
5
QAGS-C
0.785Pearson Correlation (rp)
5