List your company
ResearchFormerly WizWand

Question Answering on Simplified NQ

70.81EMElectra
36.937245.731154.52563.3189Jul 6, 2023
Updated 8mo ago

Evaluation results

MethodLinks
ElectraVerifier=false2023.0770.8174.130.88
FLAN T5Verifier=true2023.0764.9367.990.83
FLAN T5 + ALIGN VerifierVerifier=ALIGN, Unanswerable threshold selection=SQuAD v2 validation split2023.0764.9367.990.83
GPT-3.5 + ALIGN VerifierVerifier=ALIGN, Unanswerable threshold selection=Simplified NQ validation split2023.0763.5171.830.86
GPT-3.5Verifier=false2023.0758.3768.610.81
GPT-3.5mode=Zero-shot2023.0758.3768.610.81
GPT-3.5Verifier=true2023.0756.1657.40.86
GPT-3.5 + ALIGN VerifierVerifier=ALIGN, Unanswerable threshold selection=SQuAD v2 validation split (Zero-shot setting)2023.0756.1657.40.86
Flan T5Verifier=false2023.0738.2444.980.58
FLAN T5mode=Zero-shot2023.0738.2444.980.58