List-based Question Answering with Citations on QAMPARI
24.7CorrectnessChatGPT Closed Book
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ChatGPT Closed BookBase Model=ChatGPT, Pipeline Strategy=Closed Book2024.04 | 24.7 | 10 | |
| ChatGPT SnippetBase Model=ChatGPT, Pipeline Strategy=Snippet, Number of Passages=102024.04 | 22.9 | 23.9 | |
| ChatGPT SummarizationBase Model=ChatGPT, Pipeline Strategy=Summarization, Number of Passages=102024.04 | 22.3 | 24.6 | |
| ChatGPT VanillaBase Model=ChatGPT, Pipeline Strategy=Vanilla, Number of Passages=52024.04 | 20.8 | 20.7 | |
| ChatGPT Inline SearchBase Model=ChatGPT, Pipeline Strategy=Inline Search2024.04 | 18.7 | 14.9 | |
| Vicuna-13B VanillaBase Model=Vicuna-13B, Pipeline Strategy=Vanilla2024.04 | 14.9 | 12.9 | |
| LongT5 3B +Blueprint +AttributionBase Model=LongT5 3B, Pipeline Strategy=Abstractive Blueprint, Number of Passages=102024.04 | 12.9 | 10.8 | |
| LLaMA-13B VanillaBase Model=LLaMA-13B, Pipeline Strategy=Vanilla2024.04 | 9.4 | 6.9 |