Reranking on Natural Questions (NQ) (dev)
83.3Top-10 AccuracyBART-GST-A + FiD-reader
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BART-GST-A + FiD-readerreranker=BART-GST-A (Attention Projection), reader=FiD-reader2023.05 | 83.3 | 79.3 | — | |
| BART-GST-M + FiD-readerreranker=BART-GST-M (MLP Projection), reader=FiD-reader2023.05 | 83.3 | 79.6 | — | |
| BART-reranker + FiD-GST-Areranker=BART-reranker, reader=FiD-GST-A (Attention Projection)2023.05 | 83 | 78.7 | — | |
| w/o reranker + FiD-GST-Areranker=None, reader=FiD-GST-A (Attention Projection)2023.05 | 79.5 | 73.7 | — | |
| BART-GST-MProjection=MLP, Graph=AMR2023.05 | 53.2 | — | 28.4 | |
| BART-GST-AProjection=attention, Graph=AMR2023.05 | 52.7 | — | 28.1 | |
| BART-rerankerBackbone=BART2023.05 | 49.3 | — | 25.7 | |
| w/o reranker2023.05 | 37.9 | — | 20.2 |