Supporting Fact Prediction on HotpotQA distractor (dev)
89F1 ScoreGated Memory Flow
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gated Memory Flow2022.05 | 89 | 64.7 | |
| PATHFiD+cross_passage_interactions=true2022.05 | 88.7 | 64.9 | |
| SAEmodel_size=large2022.05 | 87.4 | 63.3 | |
| PATHFiD2022.05 | 85.7 | 59.3 | |
| SAEmodel_size=base2022.05 | 85.3 | 58.1 | |
| Recurrent Graph-based RetrievalReader=BERT wwm2019.11 | 85.2 | 58.6 | |
| Graph Recurrent Retrievervariant=wwm2022.05 | 85.2 | 58.6 | |
| QFE2019.11 | 84.7 | 58.8 | |
| QFE2022.05 | 84.7 | 58.8 | |
| Recurrent Graph-based RetrievalReader=BERT base2019.11 | 84.6 | 57.4 | |
| Graph Recurrent Retrievervariant=base2022.05 | 84.6 | 57.4 | |
| Baseline2019.11 | 66.7 | 22 | |
| Baseline2022.05 | 66.7 | 22 |