Open-QA Evaluation on EVOUNA-NaturalQuestions
97.9F1 ScoreAnother Human
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Another HumanQA System=GPT-42024.05 | 97.9 | 96.6 | |
| Another HumanQA System=InstructGPT2024.05 | 97.8 | 96.8 | |
| Another HumanQA System=DPR-FiD2024.05 | 97.4 | 96.3 | |
| Another HumanQA System=BingChat2024.05 | 97.2 | 95.5 | |
| Another HumanQA System=ChatGPT2024.05 | 96.5 | 95.6 | |
| GPT-3.5 (best prompting)QA System=DPR-FiD2024.05 | 95.5 | 93.9 | |
| GPT-3.5QA System=DPR-FiD2024.05 | 95.3 | 93.6 | |
| EntailmentQA System=DPR-FiD2024.05 | 94.8 | 92.5 | |
| EntailmentQA System=GPT-42024.05 | 93.8 | 90.1 | |
| EntailmentQA System=InstructGPT2024.05 | 92.7 | 90.2 | |
| EntailmentQA System=ChatGPT2024.05 | 92.6 | 88.9 | |
| EntailmentQA System=BingChat2024.05 | 92.6 | 88.1 | |
| Lexical MatchQA System=DPR-FiD2024.05 | 92 | 89.7 | |
| Entailment (small)QA System=DPR-FiD2024.05 | 91.5 | 88.5 | |
| GPT-3.5 (best prompting)QA System=GPT-42024.05 | 91.2 | 86 | |
| Entailment (small)QA System=GPT-42024.05 | 89.9 | 85 | |
| GPT-3.5 (best prompting)QA System=ChatGPT2024.05 | 89.4 | 84.5 | |
| GPT-3.5 (best prompting)QA System=InstructGPT2024.05 | 88.3 | 84.5 | |
| Entailment (small)QA System=InstructGPT2024.05 | 88 | 85.4 | |
| Lexical MatchQA System=BingChat2024.05 | 87.8 | 82.3 | |
| Entailment (small)QA System=BingChat2024.05 | 87.8 | 82 | |
| Entailment (small)QA System=ChatGPT2024.05 | 87.7 | 83.2 | |
| Lexical MatchQA System=GPT-42024.05 | 87.6 | 82.5 | |
| GPT-3.5QA System=InstructGPT2024.05 | 87.2 | 84.1 | |
| GPT-3.5 (best prompting)QA System=BingChat2024.05 | 87.1 | 80.4 | |
| Lexical MatchQA System=InstructGPT2024.05 | 86.9 | 84.8 | |
| GPT-3.5QA System=ChatGPT2024.05 | 86.9 | 82.2 | |
| GPT-3.5QA System=GPT-42024.05 | 86.8 | 80.9 | |
| Lexical MatchQA System=ChatGPT2024.05 | 85 | 80.3 | |
| BERTScoreQA System=GPT-42024.05 | 84.3 | 76 | |
| BERTScoreQA System=DPR-FiD2024.05 | 83.5 | 75.1 | |
| BERTScoreQA System=ChatGPT2024.05 | 81.2 | 72.8 | |
| BERTScoreQA System=InstructGPT2024.05 | 77.6 | 69.5 | |
| BERTScoreQA System=BingChat2024.05 | 77.5 | 67.5 | |
| GPT-3.5QA System=BingChat2024.05 | 77.3 | 69.5 |