List your company
ResearchFormerly WizWand

Question Answering on HotpotQA 500 samples (val)

34.4EMASSISTRAG
12.35218.07623.829.524Nov 11, 2024
Updated 8mo ago

Evaluation results

MethodLinks
ASSISTRAGMain LLM=ChatGPT3.5, Retrieval Setting=Baselines with retrieval2024.1134.444.846.5
ASSISTRAGMain LLM=ChatGLM3 6B, Retrieval Setting=Baselines with retrieval2024.113342.443.5
ASSISTRAGMain LLM=LLaMA2-chat 7B, Retrieval Setting=Baselines with retrieval2024.1132.441.542.6
IRCoTMain LLM=ChatGPT3.5, Retrieval Setting=Baselines with retrieval2024.1131.440.341.6
SELF-RAGMain LLM=SELF-RAG 7B, Retrieval Setting=Baselines with retrieval2024.113142.442.3
Self-AskMain LLM=ChatGPT3.5, Retrieval Setting=Baselines with retrieval2024.1128.243.144.8
LLMLinguaMain LLM=ChatGPT3.5, Retrieval Setting=Baselines with retrieval2024.1128.240.240
ReActMain LLM=ChatGPT3.5, Retrieval Setting=Baselines with retrieval2024.1126.841.742.6
Naive RAGMain LLM=ChatGPT3.5, Retrieval Setting=Baselines with retrieval2024.1124.63334.5
Naive RAGMain LLM=ChatGLM3 6B, Retrieval Setting=Baselines with retrieval2024.1121.827.225.8
CloseBookMain LLM=ChatGPT3.5, Retrieval Setting=Baselines without retrieval2024.112025.826.4
Naive RAGMain LLM=LLaMA2-chat 7B, Retrieval Setting=Baselines with retrieval2024.1118.22322.5
CloseBookMain LLM=ChatGLM3 6B, Retrieval Setting=Baselines without retrieval2024.1115.620.419.9
CloseBookMain LLM=LLaMA2-chat 7B, Retrieval Setting=Baselines without retrieval2024.1113.218.417.8