Informal description to Lean signature retrieval on mathlib
67.4R@1MathLeap-Qwen-8B
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| MathLeap-Qwen-8BParameters=8B, Base Model=Qwen2026.06 | 67.4 | 88.75 | 91.96 | 76.64 | |
| MathLeap-Octen-8BParameters=8B, Base Model=Octen2026.06 | 67.24 | 87.82 | 91.51 | 76.28 | |
| F2LLM-v2-14BParameters=14B2026.06 | 57.73 | 81.16 | 85.94 | 67.98 | |
| Octen-Embedding-8BParameters=8B2026.06 | 56.08 | 79.47 | 84.27 | 66.28 | |
| Qwen3-Embedding-8BParameters=8B2026.06 | 54.64 | 77.95 | 82.9 | 64.79 | |
| Harrier-OSS-v1-27BParameters=27B2026.06 | 54.16 | 78.79 | 84.04 | 64.76 | |
| Qwen3-Embedding-4BParameters=4B2026.06 | 49.14 | 75.22 | 81.18 | 60.37 | |
| KaLM-Gemma3-12BParameters=12B2026.06 | 47.56 | 72.83 | 79.07 | 58.31 | |
| Llama-Embed-Nemotron-8BParameters=8B2026.06 | 21.89 | 39.42 | 46.2 | 29.47 |