Long-form Question Answering on ELI5 KILT (test)
25.4F1RT + C-REALM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RT + C-REALMp (nucleus sampling)=0.9, Retriever=C-REALM2021.03 | 25.4 | 21.5 | 2.1 | |
| RT + REALMp (nucleus sampling)=0.9, Retriever=REALM2021.03 | 25.1 | 21.5 | 1.4 | |
| RT + REALMp (nucleus sampling)=0.6, Retriever=REALM2021.03 | 23.1 | 23.4 | 1.5 | |
| RT + C-REALMp (nucleus sampling)=0.6, Retriever=C-REALM2021.03 | 22.9 | 23.2 | 2.4 | |
| BART2021.03 | 19.2 | 20.6 | 0 | |
| BART + DPR2021.03 | 17.9 | 17.4 | 1.9 | |
| T5-base2021.03 | 16.1 | 19.1 | 0 | |
| RAG2021.03 | 14.5 | 14.1 | 1.7 |