CFQ
Benchmarks
TaskDatasetSOTA resultTrendResults
CFQ MCD3
95.5Accuracy
33
CFQ (MCD2)
95.3Accuracy
33
CFQ (MCD1)
98.6Accuracy
33
CFQ MCD avg
95Exact Match Accuracy
22
CFQ MCD3 (test)
77.9Accuracy
15
CFQ MCD2 (test)
0.853Accuracy
15
CFQ MCD1 (test)
88.7Accuracy
15
CFQ MCD1, MCD2, MCD3
94.3MCD1 Accuracy
9
CFQ
92.1MCD1 Score
6
CFQ Maximum Compound Divergence (MCD)
78.3MCD1
4
CFQ (MCD1, MCD2, MCD3)
87.8MCD1 Accuracy
2
CFQ 1.0 (MCD3)
—Primary metric
0
CFQ 1.0 (MCD2)
—Primary metric
0
CFQ 1.0 (MCD1)
—Primary metric
0