Mathematical Statement Retrieval on blueprints
64.73Recall@1MathLeap-Qwen-8B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MathLeap-Qwen-8BParameters=8B2026.06 | 64.73 | 93.1 | 96.44 | |
| MathLeap-Octen-8BParameters=8B2026.06 | 64.69 | 92.8 | 96.92 | |
| Octen-Embedding-8BParameters=8B2026.06 | 64.32 | 92.6 | 96.37 | |
| Qwen3-Embedding-8BParameters=8B2026.06 | 59.52 | 90.13 | 94.11 | |
| Qwen3-Embedding-4BParameters=4B2026.06 | 56.94 | 88.76 | 94.11 | |
| harrier-oss-v1-27BParameters=27B2026.06 | 55 | 85.82 | 92.07 | |
| KaLM-Embedding-Gemma3-12B-2511Parameters=12B2026.06 | 54.04 | 86.02 | 91.96 | |
| llama-embed-nemotron-8bParameters=8b2026.06 | 23.8 | 44.11 | 52.7 |