List your company
ResearchFormerly WizWand

Reading on Natural Questions (NQ) (test)

53.1EMBART-GST-M + FiD-GST-M
50.562451.221251.8852.5388May 26, 2023
Updated 8mo ago

Evaluation results

MethodLinks
BART-GST-M + FiD-GST-Mreranker=BART-GST-M (MLP Projection), reader=FiD-GST-M (MLP Projection)2023.0553.1
BART-GST-A + FiD-GST-Areranker=BART-GST-A (Attention Projection), reader=FiD-GST-A (Attention Projection)2023.0552.8
BART-reranker + FiD-GST-Areranker=BART-reranker, reader=FiD-GST-A (Attention Projection)2023.0552.38
BART-reranker + FiD-GST-Mreranker=BART-reranker, reader=FiD-GST-M (MLP Projection)2023.0552.24
BART-GST-A + FiD-readerreranker=BART-GST-A (Attention Projection), reader=FiD-reader2023.0552.18
BART-GST-M + FiD-readerreranker=BART-GST-M (MLP Projection), reader=FiD-reader2023.0552.13
BART-reranker + FiD-readerreranker=BART-reranker, reader=FiD-reader2023.0551.33
w/o reranker + FiD-GST-Areranker=None, reader=FiD-GST-A (Attention Projection)2023.0551.11
w/o reranker + FiD-GST-Mreranker=None, reader=FiD-GST-M (MLP Projection)2023.0550.97
w/o reranker + FiD-readerreranker=None, reader=FiD-reader2023.0550.66