Open Domain Question Answering on PopQA (All)
32.9AccuracyAAR
Evaluation results
| Method | Links | |
|---|---|---|
| AARSettings=Zero-shot, Model Scale=1.3B, Backbone LM=OPT, Retriever=ANCE2023.05 | 32.9 | |
| AARSettings=Zero-shot, Model Scale=1.3B, Backbone LM=GPT-neo, Retriever=ANCE2023.05 | 30.1 | |
| AARSettings=Zero-shot, Model Scale=1.3B, Backbone LM=OPT, Retriever=Contriever2023.05 | 29.1 | |
| AARSettings=Zero-shot, Model Scale=1.3B, Backbone LM=GPT-neo, Retriever=Contriever2023.05 | 27.8 | |
| OPTSettings=Few-shot, Model Scale=1.3B2023.05 | 12.3 | |
| OPT GenReadSettings=Zero-shot, Model Scale=1.3B2023.05 | 12.2 | |
| OPTSettings=Zero-shot, Model Scale=1.3B2023.05 | 12 | |
| GPT-neo GenReadSettings=Zero-shot, Model Scale=1.3B2023.05 | 11.9 | |
| GPT-neoSettings=Few-shot, Model Scale=1.3B2023.05 | 11.3 | |
| GPT-neoSettings=Zero-shot, Model Scale=1.3B2023.05 | 9.9 |