List your company
ResearchFormerly WizWand

Causal Question Answering on CausalProbe-H

0.701EMG²-Reasoner
0.559560.596280.6330.66972Jun 26, 2025
Updated 8mo ago

Evaluation results

MethodLinks
G²-ReasonerBackbone=Claude 3 opus, Temperature=1.02025.060.701
CoTModel=Claude 32025.060.701
CoTBackbone=Claude 3 opus, Temperature=1.02025.060.7
G²-ReasonerModel=Claude 32025.060.696
G²-ReasonerModel=GPT 3.52025.060.693
VanillaModel=Claude 32025.060.692
G²-ReasonerBackbone=GPT 3.5 turbo, Temperature=1.02025.060.69
VanillaBackbone=Claude 3 opus, Temperature=1.02025.060.688
RAGBackbone=Claude 3 opus, Temperature=1.02025.060.687
RAGModel=Claude 32025.060.685
RAGBackbone=GPT 3.5 turbo, Temperature=1.02025.060.678
RAGModel=GPT 3.52025.060.678
VanillaModel=GPT 3.52025.060.671
VanillaBackbone=GPT 3.5 turbo, Temperature=1.02025.060.67
CoTModel=GPT 3.52025.060.667
CoTBackbone=GPT 3.5 turbo, Temperature=1.02025.060.662
G²-ReasonerBackbone=LLaMA 32025.060.658
G²-ReasonerModel=LLaMA 3 8B2025.060.658
RAGBackbone=LLaMA 32025.060.655
RAGModel=LLaMA 3 8B2025.060.655
VanillaBackbone=LLaMA 32025.060.652
VanillaModel=LLaMA 3 8B2025.060.652
CoTBackbone=LLaMA 32025.060.644
CoTModel=LLaMA 3 8B2025.060.644
G²-ReasonerBackbone=LLaMA 22025.060.582
G²-ReasonerModel=LLaMA 2 7B2025.060.582
RAGBackbone=LLaMA 22025.060.575
RAGModel=LLaMA 2 7B2025.060.575
CoTBackbone=LLaMA 22025.060.573
CoTModel=LLaMA 2 7B2025.060.573
VanillaBackbone=LLaMA 22025.060.565
VanillaModel=LLaMA 2 7B2025.060.565