Question Answering on SQuAD (ROUGE-L, EM)
84.8ROUGE-LOracle Retriever
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Oracle RetrieverSetting=Upper bound2024.06 | 84.8 | 65.1 | |
| TrioComponents=SGPT, MPNET, and BM252024.06 | 64.1 | 48.5 | |
| SGPT + BM25Combination type=Neural + Term weighting2024.06 | 63.6 | 48.1 | |
| SGPT + MPNETCombination type=Neural + Neural2024.06 | 61.8 | 46.6 | |
| SGPT2024.06 | 61.1 | 45.8 | |
| MPNET + BM25Combination type=Neural + Term weighting2024.06 | 57.3 | 43.1 | |
| BM252024.06 | 51.9 | 39.2 | |
| MPNET2024.06 | 37 | 26.4 |