Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Logical reasoning research benchmarks – Page 3 · SOTA2 Research

Logical reasoning

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

SLR-BENCH (test)

llama-3.1-8b-SLR

11.3LRL

27

May 12, 2026

58.9Accuracy

27

May 21, 2026

RP LP Domain, Npred ≤ 30, δ ≤ 6

direct w. L = 128

100Accuracy

26

May 7, 2026

63.55Accuracy

26

Jun 15, 2026

RP LP Domain, Npred ≤ 60, 6 < δ ≤ 12

93.5Accuracy

25

May 7, 2026

RP LP Domain, Npred ≤ 60, δ ≤ 6

99.4Accuracy

25

May 7, 2026

RP LP Domain, Npred ≤ 30, 6 < δ ≤ 12

99.5Accuracy

25

May 7, 2026

86.4Accuracy

24

Jun 4, 2026

88.31Accuracy (DetectiveQA)

24

May 14, 2026

98.8BPA

24

Feb 26, 2026

91.66Accuracy

24

Feb 26, 2026

99.7Accuracy

24

Feb 26, 2026

PC-83K 1.0 (test)

91.1Normal Score

23

May 29, 2026

62Accuracy

23

Feb 26, 2026

56.2Accuracy

23

Feb 26, 2026

ReClor (test-H)

75Accuracy

23

Feb 26, 2026

ReClor (test-e)

Knowledge Model

91.8Accuracy

23

Feb 26, 2026

ReClor v1 (test)

78.1Accuracy

23

Feb 26, 2026

Qwen3-4B-Thinking-2507 + Overthink

74.35Accuracy

22

May 13, 2026

LogiQA original (test)

Llama3.1-8B-Instruct (FAIR) + Teacher-Multiple

43.16Accuracy

22

Feb 26, 2026

Oracle Verifier

53.6Accuracy

21

Jun 2, 2026

27.5Accuracy

21

Jun 2, 2026

Oracle Verifier

60.3Accuracy

21

Jun 2, 2026

Oracle Verifier

86.8Accuracy

21

Jun 2, 2026

Rule-chaining (test)

84Accuracy

21

May 26, 2026

Page 3 of 11

Popular datasets

LogiQA ReClor BBH FOLIO ProofWriter

Follow for updates

Join SOTA2 Contact