Question Answering on Simplified NQ
70.81EMElectra
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ElectraVerifier=false2023.07 | 70.81 | 74.13 | 0.88 | |
| FLAN T5Verifier=true2023.07 | 64.93 | 67.99 | 0.83 | |
| FLAN T5 + ALIGN VerifierVerifier=ALIGN, Unanswerable threshold selection=SQuAD v2 validation split2023.07 | 64.93 | 67.99 | 0.83 | |
| GPT-3.5 + ALIGN VerifierVerifier=ALIGN, Unanswerable threshold selection=Simplified NQ validation split2023.07 | 63.51 | 71.83 | 0.86 | |
| GPT-3.5Verifier=false2023.07 | 58.37 | 68.61 | 0.81 | |
| GPT-3.5mode=Zero-shot2023.07 | 58.37 | 68.61 | 0.81 | |
| GPT-3.5Verifier=true2023.07 | 56.16 | 57.4 | 0.86 | |
| GPT-3.5 + ALIGN VerifierVerifier=ALIGN, Unanswerable threshold selection=SQuAD v2 validation split (Zero-shot setting)2023.07 | 56.16 | 57.4 | 0.86 | |
| Flan T5Verifier=false2023.07 | 38.24 | 44.98 | 0.58 | |
| FLAN T5mode=Zero-shot2023.07 | 38.24 | 44.98 | 0.58 |