Question Answering on HotpotQA Challenge Set 1.0 (test)
50.15F1 ScoreAsai et al. (2019) + Pseudo-Evidentiality Training (C-II)
Evaluation Results
| Method | Links | |
|---|---|---|
| Asai et al. (2019) + Pseudo-Evidentiality Training (C-II)Input at Inference=Retrieved-evidences, Knowledge Setting=with external knowledge2021.07 | 50.15 | |
| Asai et al. (2019) (C-I)Input at Inference=Retrieved-evidences, Knowledge Setting=with external knowledge2021.07 | 48.54 | |
| Pseudo-Evidentiality Training (Full) (O-III)Input at Inference=Selected-evidences, Knowledge Setting=without external knowledge2021.07 | 44.57 | |
| Pseudo-Evidentiality Training (O-II)Input at Inference=Paired-paragraph, Knowledge Setting=without external knowledge2021.07 | 41.69 | |
| Single-paragraph QA (B-II)Input at Inference=Paired-paragraph, Knowledge Setting=without external knowledge2021.07 | 30.07 | |
| Pseudo-Evidentiality Training (O-I)Input at Inference=Single-paragraph, Knowledge Setting=without external knowledge2021.07 | 19.81 | |
| Single-paragraph QA (B-I)Input at Inference=Single-paragraph, Knowledge Setting=without external knowledge2021.07 | 0 |