Retrieval-Augmented Generation on SQuAD v0.2 (test)
0.464METEOROracle Retriever
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Oracle RetrieverReader Model=mistral-7b-instruct-v0.22024.06 | 0.464 | 0.77 | 0.298 | |
| TrioReader Model=mistral-7b-instruct-v0.22024.06 | 0.362 | 0.742 | 0.236 | |
| SGPT + BM25Reader Model=mistral-7b-instruct-v0.22024.06 | 0.359 | 0.741 | 0.233 | |
| SGPT + MPNETReader Model=mistral-7b-instruct-v0.22024.06 | 0.348 | 0.738 | 0.227 | |
| SGPTReader Model=mistral-7b-instruct-v0.22024.06 | 0.346 | 0.737 | 0.225 | |
| MPNET + BM25Reader Model=mistral-7b-instruct-v0.22024.06 | 0.328 | 0.731 | 0.213 | |
| BM25Reader Model=mistral-7b-instruct-v0.22024.06 | 0.298 | 0.722 | 0.194 | |
| MPNETReader Model=mistral-7b-instruct-v0.22024.06 | 0.225 | 0.7 | 0.143 |