Scientific Reasoning on CEval Hard
79.09Math ScoreTopoPrior+ARG
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| TopoPrior+ARGBase model=Qwen2.5-72B-Instruct2026.05 | 79.09 | — | 83.5 | 79.91 | 85.56 | |
| TopoPrior+ARGBase model=DeepSeek-V3-671B-Instruct2026.05 | 78.31 | — | 83.94 | 78.06 | 86.3 | |
| TopoPrior+APBase model=Qwen2.5-72B-Instruct2026.05 | 77.65 | — | 80.44 | 76.69 | 82.36 | |
| TopoPrior+ADBase model=Qwen2.5-72B-Instruct2026.05 | 77.55 | — | 81.36 | 77.14 | 83.79 | |
| TopoPrior+GDBase model=Qwen2.5-72B-Instruct2026.05 | 77.16 | — | 81.52 | 76.51 | 82.18 | |
| TopoPrior+ADBase model=DeepSeek-V3-671B-Instruct2026.05 | 77.14 | — | 81.95 | 76.4 | 84.79 | |
| TopoPrior+APBase model=DeepSeek-V3-671B-Instruct2026.05 | 77.03 | — | 82.41 | 76.98 | 84.81 | |
| TopoPrior+GDBase model=DeepSeek-V3-671B-Instruct2026.05 | 76.84 | — | 80.5 | 76.69 | 84.54 | |
| ARG-DesignerBase model=Qwen2.5-72B-Instruct2026.05 | 76.74 | — | 81.41 | 76.45 | 82.19 | |
| ARG-DesignerBase model=DeepSeek-V3-671B-Instruct2026.05 | 76.5 | — | 81.97 | 76.06 | 84.42 | |
| AgentDropoutBase model=DeepSeek-V3-671B-Instruct2026.05 | 76.17 | — | 80.94 | 75.8 | 83.55 | |
| AgentPruneBase model=Qwen2.5-72B-Instruct2026.05 | 75.47 | — | 79.34 | 74.84 | 82.1 | |
| AgentDropoutBase model=Qwen2.5-72B-Instruct2026.05 | 75.3 | — | 79.39 | 74.68 | 81.95 | |
| G-DesignerBase model=DeepSeek-V3-671B-Instruct2026.05 | 75.28 | — | 78.93 | 74.14 | 82.86 | |
| G-DesignerBase model=Qwen2.5-72B-Instruct2026.05 | 74.99 | — | 78.87 | 73.96 | 81.53 | |
| AgentPruneBase model=DeepSeek-V3-671B-Instruct2026.05 | 74.45 | — | 81.15 | 75.32 | 83.32 | |
| RAGBase model=Qwen2.5-72B-Instruct2026.05 | 73.4 | — | 76.73 | 71.31 | 79.91 | |
| RAGBase model=DeepSeek-V3-671B-Instruct2026.05 | 73.39 | — | 76.85 | 72.03 | 81.14 | |
| CoTBase model=DeepSeek-V3-671B-Instruct2026.05 | 72.78 | — | 75.62 | 70.81 | 80.03 | |
| CoTBase model=Qwen2.5-72B-Instruct2026.05 | 71.79 | — | 75.33 | 69.85 | 78.41 | |
| PEBase model=DeepSeek-V3-671B-Instruct2026.05 | 71.21 | — | 74.48 | 69.64 | 79.01 | |
| PEBase model=Qwen2.5-72B-Instruct2026.05 | 70.55 | — | 74.02 | 68.18 | 77.49 | |
| TopoPrior+ARGBase model=Llama3-8B-Instruct2026.05 | 49.33 | — | 55.76 | 50.89 | 57.04 | |
| TopoPrior+ADBase model=Llama3-8B-Instruct2026.05 | 48.44 | — | 53.86 | 49.87 | 56.01 | |
| TopoPrior+APBase model=Llama3-8B-Instruct2026.05 | 47.72 | — | 52.93 | 48.22 | 54.91 | |
| TopoPrior+GDBase model=Llama3-8B-Instruct2026.05 | 46.95 | — | 52.63 | 48.41 | 54.8 | |
| ARG-DesignerBase model=Llama3-8B-Instruct2026.05 | 46.73 | — | 52.59 | 47.14 | 54.25 | |
| AgentDropoutBase model=Llama3-8B-Instruct2026.05 | 45.98 | — | 52.1 | 46.96 | 53.84 | |
| G-DesignerBase model=Llama3-8B-Instruct2026.05 | 45.91 | — | 50.11 | 46.32 | 52.96 | |
| AgentPruneBase model=Llama3-8B-Instruct2026.05 | 45.24 | — | 50.85 | 45.88 | 52.89 | |
| RAGBase model=Llama3-8B-Instruct2026.05 | 44.83 | — | 47.06 | 44.12 | 51.17 | |
| DES-MoEBase model=Llama3-8B-Instruct2026.05 | 43.96 | — | 43.58 | 41.96 | 49.34 | |
| CoTBase model=Llama3-8B-Instruct2026.05 | 42.99 | — | 45.8 | 41.84 | 49.36 | |
| MoDEBase model=Llama3-8B-Instruct2026.05 | 42.77 | — | 44.02 | 42.52 | 49.26 | |
| PEBase model=Llama3-8B-Instruct2026.05 | 41.83 | — | 44.06 | 40.12 | 48.04 | |
| MoDULABase model=Llama3-8B-Instruct2026.05 | 41.8 | — | 45.62 | 41.23 | 48.64 | |
| ChatGLM2-6BParameter Scale=6B~7B2024.01 | — | 29.61 | — | — | — | |
| ChatGLM2-6B-BaseParameter Scale=6B~7B2024.01 | — | 32.9 | — | — | — | |
| ChatGLM3-32B-BaseParameter Scale=30B~32B2024.01 | — | 53.95 | — | — | — | |
| ChatGLM3-6BParameter Scale=6B~7B2024.01 | — | 36.84 | — | — | — | |
| ChatGLM3-6B-BaseParameter Scale=6B~7B2024.01 | — | 45.4 | — | — | — | |
| Claude-v1.3Parameter Scale=API2024.01 | — | 39.14 | — | — | — | |
| Galactica-6.7BParameter Scale=6B~7B2024.01 | — | 11.84 | — | — | — | |
| GPT-3.5-turboParameter Scale=API2024.01 | — | 41.37 | — | — | — | |
| GPT-4Parameter Scale=API2024.01 | — | 54.96 | — | — | — | |
| LLaMA-2-13BParameter Scale=12B~13B2024.01 | — | 19.74 | — | — | — | |
| LLaMA-2-7BParameter Scale=6B~7B2024.01 | — | 28.29 | — | — | — | |
| Llama3-8B-InstructEvaluation Protocol=zero-shot, Parameter Scale=6B~7B2024.01 | — | 26.32 | — | — | — | |
| Llama3-8B-InstructEvaluation Protocol=few-shot, Parameter Scale=6B~7B2024.01 | — | 25.66 | — | — | — | |
| Llama3-8B-Instruct + SciInstructFine-tuning=SciInstruct, Parameter Scale=6B~7B2024.01 | — | 32.24 | — | — | — | |
| Mistral-7B: MetaMATHEvaluation Protocol=zero-shot, Parameter Scale=6B~7B2024.01 | — | 9.87 | — | — | — | |
| Mistral-7B: MetaMATHEvaluation Protocol=few-shot, Parameter Scale=6B~7B2024.01 | — | 9.21 | — | — | — | |
| Mistral-7B: MetaMATH + SciInstructFine-tuning=SciInstruct, Parameter Scale=6B~7B2024.01 | — | 30.92 | — | — | — | |
| SciGLMBackbone=ChatGLM3-6B-Base, Parameter Scale=6B~7B2024.01 | — | 51.97 | — | — | — | |
| SciGLMBackbone=ChatGLM3-32B-Base, Parameter Scale=30B~32B2024.01 | — | 56.58 | — | — | — |