FeTaQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
FeTaQA
76.9Accuracy
24
FetaQA
40.1R@1
19
FetaQA
40.5BLEU
16
FetaQA original (test)
78.4Recall@10
12
FeTaQA
40.5S-BLEU
12
FeTaQA
39.05BLEU
11
FeTaQA (test)
33.8BLEU
10
FeTaQA
50.4ROUGE-L
10
FeTaQA (test)
19.32sacreBLEU
8
FeTaQA (Evaluation Set)
48Vanilla Performance
8
FeTaQA (train)
50Vanilla Score
8
FeTaQA (test)
0.326BLEU
8
FetaQA (test)
32.61BLEU
7
FetaQA
0.898Precision
6
FetaQA
96.39Precision (%)
6
FetaQA
94.3Precision
6
FetaQA (gold set)
0.637Precision
6
FeTaQA (100 randomly chosen samples)
0.98Fluency
6
FeTaQA 13 (test)
62.7S-BLEU
4
FeTaQA (sample (100 samples))
45Precision
4
FeTaQA
0.334BLEU
4