List your company
ResearchFormerly WizWand

Conversational Response Generation on OR-QUAC (test)

17.8F1 ScoreChatGPT
12.39213.79615.216.604Jul 9, 2025
Updated 8mo ago

Evaluation results

MethodLinks
ChatGPTretrieval_mode=Zero-shot (w/o retrieval)2025.0717.8
UniConvretrieval_mode=RAG (w/. retrieval), generator=Mistral-7B-chat2025.0717.8
Clauderetrieval_mode=Zero-shot (w/o retrieval)2025.0717.5
Mistralretrieval_mode=Zero-shot (w/o retrieval)2025.0717.4
ChatRetriever + Mistralretrieval_mode=RAG (w/. retrieval), generator=Mistral-7B-chat2025.0717.3
GRITretrieval_mode=Zero-shot (w/o retrieval)2025.0717
Conv-ANCE + Mistralretrieval_mode=RAG (w/. retrieval), generator=Mistral-7B-chat2025.0717
Conv-GRITretrieval_mode=Zero-shot (w/o retrieval)2025.0714.5
UniConvretrieval_mode=Zero-shot (w/o retrieval)2025.0712.6