List your company
ResearchFormerly WizWand

Logical Reasoning on ProverQA hard split

0.686AccuracyLogicAgent
0.38440.46270.5410.6193Sep 29, 2025
Updated 6mo ago

Evaluation results

MethodLinks
LogicAgentType=AR+SR, Base Model=Qwen2.52025.090.686
Logic-LMType=SR, Base Model=Qwen2.52025.090.624
SymbCoTType=SR, Base Model=Qwen2.52025.090.572
AristotleType=AR+SR, Base Model=Qwen2.52025.090.562
ToTType=AR, Base Model=Qwen2.52025.090.534
CRType=AR, Base Model=Qwen2.52025.090.518
CoTType=LR, Base Model=Qwen2.52025.090.472
NaiveType=LR, Base Model=Qwen2.52025.090.396