Lean Signature to Lean Type Retrieval on mathlib v4.16.0 benchmark leaderboard · SOTA2 Research

Lean Signature to Lean Type Retrieval on mathlib v4.16.0

73.34R@1MathLeap-Octen-8B

Evaluation Results

Method	Links
MathLeap-Octen-8B2026.06		73.34	89.68	92.59	80.56
MathLeap-Qwen-8B2026.06		72.46	89.01	92.06	79.82
F2LLM-v2-14B2026.06		70.43	90.41	93.63	79.22
Octen-Embedding-8B2026.06		70.04	89.27	92.31	78.45
Qwen3-Embedding-8B2026.06		69.08	89.1	92.5	77.88
KaLM-Gemma3-12B2026.06		67.16	87.33	90.83	76.03
Qwen3-Embedding-4B2026.06		64.41	86.24	90.19	73.98
Harrier-OSS-v1-27B2026.06		61.74	84.45	88.69	71.52
Llama-Embed-Nemotron-8B2026.06		16.57	28.67	33.59	21.79