List your company
ResearchFormerly WizWand

Reading on TriviaQA (TQ) (dev)

0.7263Exact Match (EM)BART-GST-A + FiD-GST-A
0.6887560.6985030.708250.717997May 26, 2023
Updated 8mo ago

Evaluation results

MethodLinks
BART-GST-A + FiD-GST-Areranker=BART-GST-A (Attention Projection), reader=FiD-GST-A (Attention Projection)2023.050.7263
BART-GST-M + FiD-GST-Mreranker=BART-GST-M (MLP Projection), reader=FiD-GST-M (MLP Projection)2023.050.7258
BART-reranker + FiD-GST-Mreranker=BART-reranker, reader=FiD-GST-M (MLP Projection)2023.050.7212
BART-reranker + FiD-GST-Areranker=BART-reranker, reader=FiD-GST-A (Attention Projection)2023.050.7193
BART-GST-A + FiD-readerreranker=BART-GST-A (Attention Projection), reader=FiD-reader2023.050.7154
BART-GST-M + FiD-readerreranker=BART-GST-M (MLP Projection), reader=FiD-reader2023.050.7147
BART-reranker + FiD-readerreranker=BART-reranker, reader=FiD-reader2023.050.7116
w/o reranker + FiD-GST-Areranker=None, reader=FiD-GST-A (Attention Projection)2023.050.7017
w/o reranker + FiD-GST-Mreranker=None, reader=FiD-GST-M (MLP Projection)2023.050.6998
w/o reranker + FiD-readerreranker=None, reader=FiD-reader2023.050.6902