ECQA
Benchmarks
TaskDatasetSOTA resultTrendResults
ECQA
77.4MV Score
27
ECQA
83.96CACC
25
ECQA (test)
79.7Accuracy
13
ECQA
70.34Accuracy
12
ECQA
73.33Human Evaluation Score
7
ECQA (out-domain)
2.99Grammar Score
7
ECQA (test)
59.4Accuracy
6
ECQA complete (test)
87.67BERTScore
6
ECQA (test)
71.11Accuracy
4
ECQA
0.398COS-E
4
ECQA
87CSR
3
ECQA
20.15Perplexity (PPL)
3
ECQA
0.761Pass@1
3
ECQA few-shot 60-shot
24.53Accuracy
3
ECQA
57.2Performance Score (Finetune Baseline vs Predict Baseline)
2