List your company
ResearchFormerly WizWand

Logical Reasoning on RP LP Domain, Npred ≤ 60, δ ≤ 6

99.4Accuracycot w. L = 64
76.41682.38388.3594.317May 5, 2026
Updated 6mo ago

Evaluation results

MethodLinks
cot w. L = 64Reasoning Strategy=CoT, Number of Layers=642026.0599.4
direct w. L = 128Reasoning Strategy=Direct, Number of Layers=1282026.0599.2
direct w. L = 128Reasoning Strategy=Direct, Number of Layers=1282026.0598.9
cot w. L = 128Reasoning Strategy=CoT, Number of Layers=1282026.0598.6
direct w. L = 64Reasoning Strategy=Direct, Number of Layers=642026.0598.5
direct w. L = 96Reasoning Strategy=Direct, Number of Layers=962026.0598.4
cot w. L = 64Reasoning Strategy=CoT, Number of Layers=642026.0597.8
direct w. L = 48Reasoning Strategy=Direct, Number of Layers=482026.0597.6
direct w. L = 32Reasoning Strategy=Direct, Number of Layers=322026.0597.5
cot w. L = 128Reasoning Strategy=CoT, Number of Layers=1282026.0597
direct w. L = 24Reasoning Strategy=Direct, Number of Layers=242026.0596.7
cot w. L = 96Reasoning Strategy=CoT, Number of Layers=962026.0596.7
cot w. L = 48Reasoning Strategy=CoT, Number of Layers=482026.0596.6
cot w. L = 24Reasoning Strategy=CoT, Number of Layers=242026.0595.7
cot w. L = 32Reasoning Strategy=CoT, Number of Layers=322026.0595.4
cot (baseline)Reasoning Strategy=CoT2026.0594.7
cot w. L = 16Reasoning Strategy=CoT, Number of Layers=162026.0592.4
direct w. L = 16Reasoning Strategy=Direct, Number of Layers=162026.0592.2
direct (baseline)Reasoning Strategy=Direct2026.0591.8
cot (baseline)Reasoning Strategy=CoT2026.0588.2
cot w. Nepochs = 60Reasoning Strategy=CoT, N_epochs=602026.0585.3
cot w. Nepochs = 30Reasoning Strategy=CoT, N_epochs=302026.0585.1
direct (baseline)Reasoning Strategy=Direct2026.0580.9
direct w. Nepochs = 30Reasoning Strategy=Direct, N_epochs=302026.0578.3
direct w. Nepochs = 60Reasoning Strategy=Direct, N_epochs=602026.0577.3