List your company
ResearchFormerly WizWand

Single-hop Question Answering on Complex-TR ODQA 1.0 (test)

49Set AccuracyFiD-PIT + Refine
16.2424.74533.2541.755Nov 16, 2023
Updated 8mo ago

Evaluation results

MethodLinks
FiD-PIT + RefineModel Backbone=T5-large, Architecture=FiD, Reasoning Enhancement=PIT, Context Refinement=true2023.114949.7
FiD-PITModel Backbone=T5-large, Architecture=FiD, Reasoning Enhancement=PIT2023.1146.947.8
FiDModel Backbone=T5-large, Architecture=FiD2023.1146.246.6
FiD-PIT + RefineModel Backbone=T5-base, Architecture=FiD, Reasoning Enhancement=PIT, Context Refinement=true2023.1142.744.3
PIT-SFTModel Backbone=T5-base, Architecture=SFT, Reasoning Enhancement=PIT2023.1139.940.8
FiD-PITModel Backbone=T5-base, Architecture=FiD, Reasoning Enhancement=PIT2023.1139.240.1
PIT-SFTModel Backbone=T5-large, Architecture=SFT, Reasoning Enhancement=PIT2023.1139.240.1
SFTModel Backbone=T5-large, Architecture=SFT2023.113535.7
SFTModel Backbone=T5-base, Architecture=SFT2023.1133.635.6
FiDModel Backbone=T5-base, Architecture=FiD2023.1133.635.6
FLAN-T5-XLModel Backbone=FLAN-T5-XL2023.1130.131.5
GPT-4Model Backbone=GPT-42023.1119.635.1
GPT-3.5Model Backbone=GPT-3.52023.1117.526.3