MCQA
Benchmarks
TaskDatasetSOTA resultTrendResults
MCQA
93.5Accuracy
29
MCQA
2.52CPR
21
MCQA
1.13CPR (Faithfulness Score)
14
MCQA (val)
92Accuracy
10
MCQA (test)
90.75AP (Exact Counterfactual Accuracy)
6
MCQA events
80.56Coverage
2
MCQA landmarks
79.54Coverage
2
MCQA movies
81.79Coverage
2
MCQA cities
79.08Coverage
2
MCQA books
82.02Coverage
2
MCQA artworks
79.29Coverage
2
MCQA persons
81.37Coverage
2
MCQA inventions
84.59Coverage
2