List your company
ResearchFormerly WizWand

Question Answering on HotpotQA (Average Performance Score)

78.4Average Performance ScoreDeepSeek-R1 w/ GuarantRAG
66.23269.39172.5575.709Apr 9, 2026
Updated 6mo ago

Evaluation results

MethodLinks
DeepSeek-R1 w/ GuarantRAGBackbone=DeepSeek-R1, RAG Strategy=GuarantRAG, Retriever=BM252026.0478.4
DeepSeek-R1 w/ P-RAGBackbone=DeepSeek-R1, RAG Strategy=P-RAG, Retriever=BM252026.0476.9
DeepSeek-V3 w/ GuarantRAGBackbone=DeepSeek-V3, RAG Strategy=GuarantRAG, Retriever=BM252026.0476.8
Gemini-2.5-Pro w/ GuarantRAGBackbone=Gemini-2.5-Pro, RAG Strategy=GuarantRAG, Retriever=BM252026.0475.6
DeepSeek-R1 w/ SelfRAGBackbone=DeepSeek-R1, RAG Strategy=SelfRAG, Retriever=BM252026.0475.3
DeepSeek-V3 w/ P-RAGBackbone=DeepSeek-V3, RAG Strategy=P-RAG, Retriever=BM252026.0475.2
Claude-3.7-Sonnet w/ GuarantRAGBackbone=Claude-3.7-Sonnet, RAG Strategy=GuarantRAG, Retriever=BM252026.0474.3
Gemini-2.5-Pro w/ P-RAGBackbone=Gemini-2.5-Pro, RAG Strategy=P-RAG, Retriever=BM252026.0474.1
DeepSeek-V3 w/ SelfRAGBackbone=DeepSeek-V3, RAG Strategy=SelfRAG, Retriever=BM252026.0473.8
DeepSeek-R1 w/ Standard RAGBackbone=DeepSeek-R1, RAG Strategy=Standard RAG, Retriever=BM252026.0473.7
Claude-3.7-Sonnet w/ P-RAGBackbone=Claude-3.7-Sonnet, RAG Strategy=P-RAG, Retriever=BM252026.0472.8
Gemini-2.5-Pro w/ SelfRAGBackbone=Gemini-2.5-Pro, RAG Strategy=SelfRAG, Retriever=BM252026.0472.4
DeepSeek-V3 w/ Standard RAGBackbone=DeepSeek-V3, RAG Strategy=Standard RAG, Retriever=BM252026.0472.1
DeepSeek-R1Backbone=DeepSeek-R1, RAG Strategy=Base, Retriever=BM252026.0471.2
Claude-3.7-Sonnet w/ SelfRAGBackbone=Claude-3.7-Sonnet, RAG Strategy=SelfRAG, Retriever=BM252026.0471.1
Gemini-2.5-Pro w/ Standard RAGBackbone=Gemini-2.5-Pro, RAG Strategy=Standard RAG, Retriever=BM252026.0470.8
Claude-3.7-Sonnet w/ Standard RAGBackbone=Claude-3.7-Sonnet, RAG Strategy=Standard RAG, Retriever=BM252026.0469.5
DeepSeek-V3Backbone=DeepSeek-V3, RAG Strategy=Base, Retriever=BM252026.0469.4
Gemini-2.5-ProBackbone=Gemini-2.5-Pro, RAG Strategy=Base, Retriever=BM252026.0468.1
Claude-3.7-SonnetBackbone=Claude-3.7-Sonnet, RAG Strategy=Base, Retriever=BM252026.0466.7