List your company
ResearchFormerly WizWand

Question Answering on StrategyQA (accuracy)

90.4AccuracyPaLM2
-2.05621.94745.9569.953Feb 10, 2026Feb 14, 2026Feb 19, 2026Feb 23, 2026Feb 28, 2026Mar 4, 2026Mar 9, 2026
Updated 7mo ago

Evaluation results

MethodLinks
PaLM2Backbone=PaLM2 (340B), Retrieve=✗, Specification=-2026.0390.4
Gt-MarginModel=LLaDA-8B, Completion length=1282026.0284
Gt-MarginModel=Dream-7B, Completion length=1282026.0283.5
PaLMBackbone=PaLM (540B), Retrieve=✗, Specification=CoT + SC2026.0381.6
Top-ProbModel=Dream-7B, Completion length=1282026.0278.5
GEEKBackbone=Flan-T5 (11B), Retrieve=✓, Specification=CoT+SE2026.0378.17
RRBackbone=text-davinci-002 (175B), Retrieve=✓, Specification=CoT2026.0377.73
Xie et al., 2023Backbone=code-davinci-002 (175B), Retrieve=✗, Specification=-2026.0377.2
MarginModel=Dream-7B, Completion length=1282026.0276.5
GEEKBackbone=Flan-T5 (11B), Retrieve=✓, Specification=CoT2026.0375.98
PaLMBackbone=PaLM (540B), Retrieve=✗, Specification=-2026.0373.9
FaithfulCoTBackbone=code-davinci-002 (175B), Retrieve=✗, Specification=-2026.0373.2
Gt-ProbModel=Dream-7B, Completion length=1282026.0270.5
ViscondeBackbone=text-davinci-002 (175B), Retrieve=✓, Specification=CoT2026.0369.43
Lazaridou et al., 2022Backbone=Gopher (280B), Retrieve=✓, Specification=-2026.0366.2
MarginModel=LLaDA-8B, Completion length=1282026.0265.5
RandomModel=Dream-7B, Completion length=1282026.0264
ARModel=LLaDA-8B, Completion length=1282026.0263.5
Inverse-ARModel=LLaDA-8B, Completion length=1282026.0263.5
Top-ProbModel=LLaDA-8B, Completion length=1282026.0263.5
ChatGPTBackbone=GPT-3.5 (175B), Retrieve=✗, Specification=CoT2026.0362.5
ARModel=Dream-7B, Completion length=1282026.0260.9
ChatGPTBackbone=GPT-3.5 (175B), Retrieve=✗, Specification=Without CoT2026.0359.2
Gt-ProbModel=LLaDA-8B, Completion length=1282026.0250.5
RandomModel=LLaDA-8B, Completion length=1282026.0241.5
Inverse-ARModel=Dream-7B, Completion length=1282026.021.5