Retrieval on ELI5 KILT (test)
11Retrieval PrecisionRAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RAG2021.03 | 11 | 22.9 | |
| BART + DPR2021.03 | 10.7 | 26.9 | |
| RT + C-REALMp (nucleus sampling)=0.6, Retriever=C-REALM2021.03 | 10.7 | 24.6 | |
| RT + C-REALMp (nucleus sampling)=0.9, Retriever=C-REALM2021.03 | 10.2 | 24.4 | |
| RT + REALMp (nucleus sampling)=0.9, Retriever=REALM2021.03 | 6.7 | 15.5 | |
| RT + REALMp (nucleus sampling)=0.6, Retriever=REALM2021.03 | 6.7 | 15.7 | |
| T5-base2021.03 | 0 | 0 | |
| BART2021.03 | 0 | 0 |