Theorem Search on arXiv Paper-level (val)
24.3P@1Qwen3 8B
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen3 8BReranking=None2026.02 | 24.3 | 50.5 | 56.8 | 32.8 | |
| Qwen3 8BReranking=Qwen3-Reranker-0.6B2026.02 | 24.3 | 50.5 | 56.8 | 32.8 | |
| Gemini 3 Pro2026.02 | 17.1 | 25.2 | 27 | 19.6 | |
| Google SearchContext=Paper-level only2026.02 | 16.2 | 37.8 | 37.8 | 23.7 | |
| Qwen3 0.6B2026.02 | 15.3 | 34.2 | 35.1 | 21.5 | |
| Chat-GPT 5.22026.02 | 11.7 | 18 | 19.8 | 13.9 | |
| Gemma 0.3BInput Format=Standard2026.02 | 10.8 | 22.5 | 30.6 | 15.4 | |
| Gemma 0.3BInput Format=LaTeX2026.02 | 5.4 | 11.7 | 13.5 | 7 | |
| arXiv SearchContext=Paper-level only2026.02 | 0.9 | 1.8 | 2.7 | 1.1 |