List your company
ResearchFormerly WizWand

Question Answering on HotpotQA Challenge Set 1.0 (test)

50.15F1 ScoreAsai et al. (2019) + Pseudo-Evidentiality Training (C-II)
-2.00611.534525.07538.6155Jul 7, 2021
Updated 8mo ago

Evaluation results

MethodLinks
Asai et al. (2019) + Pseudo-Evidentiality Training (C-II)Input at Inference=Retrieved-evidences, Knowledge Setting=with external knowledge2021.0750.15
Asai et al. (2019) (C-I)Input at Inference=Retrieved-evidences, Knowledge Setting=with external knowledge2021.0748.54
Pseudo-Evidentiality Training (Full) (O-III)Input at Inference=Selected-evidences, Knowledge Setting=without external knowledge2021.0744.57
Pseudo-Evidentiality Training (O-II)Input at Inference=Paired-paragraph, Knowledge Setting=without external knowledge2021.0741.69
Single-paragraph QA (B-II)Input at Inference=Paired-paragraph, Knowledge Setting=without external knowledge2021.0730.07
Pseudo-Evidentiality Training (O-I)Input at Inference=Single-paragraph, Knowledge Setting=without external knowledge2021.0719.81
Single-paragraph QA (B-I)Input at Inference=Single-paragraph, Knowledge Setting=without external knowledge2021.070