Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

mathlib dataset and benchmarks · SOTA2 Research

Research Datasets

mathlib

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Lean type to informal description retrieval

mathlib (test)

72.77R@1

18

Informal description to Lean signature retrieval

mathlib

67.4R@1

9

Informal description to Lean type retrieval

mathlib (test)

70.18R@1

9

Lean signature to Lean type retrieval

mathlib v4.16.0

73.34R@1

9

Mathematical Retrieval

mathlib Lean type to Lean signature (test)

65.26R@1

9

Formal Theorem Proving

mathlib (val)

62.6Pass@1

9

Proof Optimization (Length)

Mathlib

6.19Improvement

4

Library Overlap Analysis

Mathlib

5Overlap

3

Formal Theorem Proving

mathlib (test)

63Pass@1

3

Proof Optimization (Declarativity)

Mathlib

4.63Improvement

2

Popular tasks

Formal Theorem Proving Proof Optimization (Length)Proof Optimization (Declarativity)Library Overlap Analysis Mathematical Retrieval

Follow for updates

Join SOTA2 Contact