List your company

Conversational Question Answering on CHATRAG BENCH

69.09Average ScoreChatQA-1.0-70B vs GPT-4-0613
11.598826.524441.4556.3756Jan 18, 2024

Evaluation results

MethodLinks
ChatQA-1.0-70B vs GPT-4-0613Evaluation Protocol=Human A/B Testing, Outcome=Tie Rate2024.0169.096873.3377.228057.7867.7861.6760.6978.3366.11
GPT-4-0613Evaluation Protocol=Human A/B Testing, Outcome=Win Rate vs ChatQA-1.0-70B2024.0117.117.711511.6712.2219.4415.5527.222013.8918.33
ChatQA-1.0-70BEvaluation Protocol=Human A/B Testing, Outcome=Win Rate vs GPT-4-06132024.0113.8114.2911.6711.117.7822.7816.6711.1119.317.7815.56