Reading on TriviaQA (TQ) (dev)
0.7263Exact Match (EM)BART-GST-A + FiD-GST-A
Evaluation Results
| Method | Links | |
|---|---|---|
| BART-GST-A + FiD-GST-Areranker=BART-GST-A (Attention Projection), reader=FiD-GST-A (Attention Projection)2023.05 | 0.7263 | |
| BART-GST-M + FiD-GST-Mreranker=BART-GST-M (MLP Projection), reader=FiD-GST-M (MLP Projection)2023.05 | 0.7258 | |
| BART-reranker + FiD-GST-Mreranker=BART-reranker, reader=FiD-GST-M (MLP Projection)2023.05 | 0.7212 | |
| BART-reranker + FiD-GST-Areranker=BART-reranker, reader=FiD-GST-A (Attention Projection)2023.05 | 0.7193 | |
| BART-GST-A + FiD-readerreranker=BART-GST-A (Attention Projection), reader=FiD-reader2023.05 | 0.7154 | |
| BART-GST-M + FiD-readerreranker=BART-GST-M (MLP Projection), reader=FiD-reader2023.05 | 0.7147 | |
| BART-reranker + FiD-readerreranker=BART-reranker, reader=FiD-reader2023.05 | 0.7116 | |
| w/o reranker + FiD-GST-Areranker=None, reader=FiD-GST-A (Attention Projection)2023.05 | 0.7017 | |
| w/o reranker + FiD-GST-Mreranker=None, reader=FiD-GST-M (MLP Projection)2023.05 | 0.6998 | |
| w/o reranker + FiD-readerreranker=None, reader=FiD-reader2023.05 | 0.6902 |