Theorem Question Answering on TheoremQA standard (test)
56AccuracyOurs (theory-guided context selection strategy)
Evaluation results
| Method | Links | |
|---|---|---|
| Ours (theory-guided context selection strategy)Model=Qwen3-8B2026.02 | 56 | |
| ExpRAGModel=Qwen3-8B2026.02 | 55.6 | |
| ReMemModel=Qwen3-8B2026.02 | 55.6 | |
| DCModel=Qwen3-8B2026.02 | 55.4 | |
| BM25Model=Qwen3-8B2026.02 | 54.8 | |
| ZeroModel=Qwen3-8B2026.02 | 54.6 | |
| Ours (theory-guided context selection strategy)Model=Llama-3.1-8B2026.02 | 28 | |
| ReMemModel=Llama-3.1-8B2026.02 | 27.7 | |
| DCModel=Llama-3.1-8B2026.02 | 27.6 | |
| ExpRAGModel=Llama-3.1-8B2026.02 | 27.6 | |
| BM25Model=Llama-3.1-8B2026.02 | 27 | |
| ZeroModel=Llama-3.1-8B2026.02 | 26.8 |