Question Answering on HotpotQA 500 samples (val)
34.4EMASSISTRAG
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ASSISTRAGMain LLM=ChatGPT3.5, Retrieval Setting=Baselines with retrieval2024.11 | 34.4 | 44.8 | 46.5 | |
| ASSISTRAGMain LLM=ChatGLM3 6B, Retrieval Setting=Baselines with retrieval2024.11 | 33 | 42.4 | 43.5 | |
| ASSISTRAGMain LLM=LLaMA2-chat 7B, Retrieval Setting=Baselines with retrieval2024.11 | 32.4 | 41.5 | 42.6 | |
| IRCoTMain LLM=ChatGPT3.5, Retrieval Setting=Baselines with retrieval2024.11 | 31.4 | 40.3 | 41.6 | |
| SELF-RAGMain LLM=SELF-RAG 7B, Retrieval Setting=Baselines with retrieval2024.11 | 31 | 42.4 | 42.3 | |
| Self-AskMain LLM=ChatGPT3.5, Retrieval Setting=Baselines with retrieval2024.11 | 28.2 | 43.1 | 44.8 | |
| LLMLinguaMain LLM=ChatGPT3.5, Retrieval Setting=Baselines with retrieval2024.11 | 28.2 | 40.2 | 40 | |
| ReActMain LLM=ChatGPT3.5, Retrieval Setting=Baselines with retrieval2024.11 | 26.8 | 41.7 | 42.6 | |
| Naive RAGMain LLM=ChatGPT3.5, Retrieval Setting=Baselines with retrieval2024.11 | 24.6 | 33 | 34.5 | |
| Naive RAGMain LLM=ChatGLM3 6B, Retrieval Setting=Baselines with retrieval2024.11 | 21.8 | 27.2 | 25.8 | |
| CloseBookMain LLM=ChatGPT3.5, Retrieval Setting=Baselines without retrieval2024.11 | 20 | 25.8 | 26.4 | |
| Naive RAGMain LLM=LLaMA2-chat 7B, Retrieval Setting=Baselines with retrieval2024.11 | 18.2 | 23 | 22.5 | |
| CloseBookMain LLM=ChatGLM3 6B, Retrieval Setting=Baselines without retrieval2024.11 | 15.6 | 20.4 | 19.9 | |
| CloseBookMain LLM=LLaMA2-chat 7B, Retrieval Setting=Baselines without retrieval2024.11 | 13.2 | 18.4 | 17.8 |