Benchmarks

Task NameDataset NameSOTA ResultTrendResults

Multi-Hop QA (HotpotQA, 2Wiki, Musique, Bamboogle) (test)

57.02HotpotQA Score

Multi-Hop QA (HotpotQA, 2Wiki, Musique, Bamboogle)

64.6HotpotQA Score

Multi-Hop QA

89.342Wiki Accuracy

Multi-Hop QA

73.1Accuracy

Multi-hop QA Domain-level stream

52.31AA Score

Multi-Hop QA Aggregate

45.3Average Score

Multi-Hop QA Average

0.378EM

Multi-Hop QA Full Context

86.06Accuracy

Multi-Hop QA Partial Context

72.1Accuracy

Multi-Hop QA Zero-Shot

66.6Accuracy (Zero-Shot)