List your company
ResearchFormerly WizWand

Question Answering on NQ DPR 3610 questions

50EMRankRAG
26.70432.75238.844.848Jul 2, 2024
Updated 8mo ago

Evaluation results

MethodLinks
RankRAGBackbone=Llama-3, Model size=70B2024.0750
RankRAGBackbone=Llama-2, Model size=70B2024.0748.7
RankRAGBackbone=Llama-2, Model size=13B2024.0746.2
RankRAGBackbone=Llama-3, Model size=8B2024.0746.1
ChatQA-1.5Backbone=Llama-3, Model size=70B2024.0746
ChatQA-1.0Backbone=Llama-2, Model size=70B2024.0745
ChatQA-1.5Backbone=Llama-3, Model size=8B2024.0744.1
ChatQA-1.0Backbone=Llama-2, Model size=13B2024.0743.9
RankRAGBackbone=Llama-2, Model size=7B2024.0742.4
GPT-3.5-0613 RAGModel Family=OpenAI GPT, RAG=true2024.0742.3
GPT-4-turbo-2024-0409Model Family=OpenAI GPT2024.0738.3
Llama-2-ChatBackbone=Llama-2, Configuration=Llama-2 RAG 70B, RAG=true2024.0737.7
Llama-3-InstructBackbone=Llama-3, Model size=70B, RAG=true2024.0737.3
GPT-4-0613Model Family=OpenAI GPT2024.0737.2
ChatQA-1.0Backbone=Llama-2, Model size=7B2024.0737
GPT-4-turbo-2024-0409 RAGModel Family=OpenAI GPT, RAG=true2024.0736.3
GPT-4-0613 RAGModel Family=OpenAI GPT, RAG=true2024.0736.2
GPT-3.5-0613Model Family=OpenAI GPT2024.0735.2
Llama-3-InstructBackbone=Llama-3, Model size=8B, RAG=true2024.0727.6