Reading on Natural Questions (NQ) (test)
53.1EMBART-GST-M + FiD-GST-M
Evaluation Results
| Method | Links | |
|---|---|---|
| BART-GST-M + FiD-GST-Mreranker=BART-GST-M (MLP Projection), reader=FiD-GST-M (MLP Projection)2023.05 | 53.1 | |
| BART-GST-A + FiD-GST-Areranker=BART-GST-A (Attention Projection), reader=FiD-GST-A (Attention Projection)2023.05 | 52.8 | |
| BART-reranker + FiD-GST-Areranker=BART-reranker, reader=FiD-GST-A (Attention Projection)2023.05 | 52.38 | |
| BART-reranker + FiD-GST-Mreranker=BART-reranker, reader=FiD-GST-M (MLP Projection)2023.05 | 52.24 | |
| BART-GST-A + FiD-readerreranker=BART-GST-A (Attention Projection), reader=FiD-reader2023.05 | 52.18 | |
| BART-GST-M + FiD-readerreranker=BART-GST-M (MLP Projection), reader=FiD-reader2023.05 | 52.13 | |
| BART-reranker + FiD-readerreranker=BART-reranker, reader=FiD-reader2023.05 | 51.33 | |
| w/o reranker + FiD-GST-Areranker=None, reader=FiD-GST-A (Attention Projection)2023.05 | 51.11 | |
| w/o reranker + FiD-GST-Mreranker=None, reader=FiD-GST-M (MLP Projection)2023.05 | 50.97 | |
| w/o reranker + FiD-readerreranker=None, reader=FiD-reader2023.05 | 50.66 |