Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Premise Selection research benchmarks · SOTA2 Research

Premise Selection

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Isabelle (IS) Premise Selection (test)

Llama-3.1 (RULES)

86.3Exact Match Accuracy

12

Feb 26, 2026

90.3Accuracy

8

Feb 26, 2026

Premise Selection (val)

26.4Recall

6

Jun 25, 2026

LeanDojo Benchmark 4 Lean 3 (novel_premises)

9.8R@1

6

Feb 26, 2026

LeanDojo Benchmark (random)

ReProver (Ours)

13.5R@1

5

Feb 26, 2026

83Accuracy

4

May 6, 2026

99Accuracy

4

May 6, 2026

94Accuracy

2

May 6, 2026

BidirDagLSTM-AttDagLSTM

81Accuracy

2

Feb 26, 2026

LeanDojo Benchmark 4 Lean 3 (random)

12.8R@1

1

Feb 26, 2026

Popular datasets

LeanDojo DS HolStep DL Mizar

Follow for updates

Join SOTA2 Contact