Long-form Question Answering with Citations on ELI5
0.186CorrectnessChatGPT Inline Search
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ChatGPT Inline SearchBase Model=ChatGPT, Pipeline Strategy=Inline Search2024.04 | 0.186 | 0.446 | |
| ChatGPT Closed BookBase Model=ChatGPT, Pipeline Strategy=Closed Book2024.04 | 0.186 | 0.155 | |
| ChatGPT SnippetBase Model=ChatGPT, Pipeline Strategy=Snippet, Number of Passages=102024.04 | 0.143 | 0.475 | |
| ChatGPT SummarizationBase Model=ChatGPT, Pipeline Strategy=Summarization, Number of Passages=102024.04 | 0.123 | 0.498 | |
| ChatGPT VanillaBase Model=ChatGPT, Pipeline Strategy=Vanilla, Number of Passages=52024.04 | 0.12 | 0.505 | |
| Vicuna-13B VanillaBase Model=Vicuna-13B, Pipeline Strategy=Vanilla2024.04 | 0.1 | 0.174 | |
| LongT5 3B +Blueprint +AttributionBase Model=LongT5 3B, Pipeline Strategy=Abstractive Blueprint, Number of Passages=102024.04 | 0.052 | 0.609 | |
| LLaMA-13B VanillaBase Model=LLaMA-13B, Pipeline Strategy=Vanilla2024.04 | 0.039 | 0.039 |