List your company
ResearchFormerly WizWand

Reading on TriviaQA (test)

72.67Exact Match (EM)BART-GST-A + FiD-GST-A
69.373270.229171.08571.9409May 26, 2023
Updated 8mo ago

Evaluation results

MethodLinks
BART-GST-A + FiD-GST-Areranker=BART-GST-A (Attention Projection), reader=FiD-GST-A (Attention Projection)2023.0572.67
BART-GST-M + FiD-GST-Mreranker=BART-GST-M (MLP Projection), reader=FiD-GST-M (MLP Projection)2023.0572.61
BART-reranker + FiD-GST-Mreranker=BART-reranker, reader=FiD-GST-M (MLP Projection)2023.0572.24
BART-reranker + FiD-GST-Areranker=BART-reranker, reader=FiD-GST-A (Attention Projection)2023.0572.05
BART-GST-A + FiD-readerreranker=BART-GST-A (Attention Projection), reader=FiD-reader2023.0571.71
BART-GST-M + FiD-readerreranker=BART-GST-M (MLP Projection), reader=FiD-reader2023.0571.62
BART-reranker + FiD-readerreranker=BART-reranker, reader=FiD-reader2023.0571.33
w/o reranker + FiD-GST-Areranker=None, reader=FiD-GST-A (Attention Projection)2023.0570.39
w/o reranker + FiD-GST-Mreranker=None, reader=FiD-GST-M (MLP Projection)2023.0570.1
w/o reranker + FiD-readerreranker=None, reader=FiD-reader2023.0569.5