List your company
ResearchFormerly WizWand

Question Answering on NarrativeQA Trun. latest (test)

21.34Average ScoreCoA
1.59046.717711.84516.9723Jun 4, 2024
Updated 8mo ago

Evaluation results

MethodLinks
CoABackbone=Claude-3-Haiku, Context Window=8k2024.0621.34
CoABackbone=Claude-3-Opus, Context Window=8k2024.0621.26
CoABackbone=Claude-3-Sonnet, Context Window=8k2024.0616.47
RAGBackbone=Claude-3-Sonnet, Context Window=8k2024.065.17
RAGBackbone=Claude-3-Opus, Context Window=8k2024.064.29
RAGBackbone=Claude-3-Haiku, Context Window=8k2024.064.22
VanillaBackbone=Claude-3-Haiku, Context Window=200k2024.062.5
VanillaBackbone=Claude-3-Sonnet, Context Window=200k2024.062.44
VanillaBackbone=Claude-3-Opus, Context Window=200k2024.062.35