Scientific Reasoning on ScienceEval
87.64Mechanics Score 1ROUNDTABLE POLICY
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| ROUNDTABLE POLICYModel=Ours(RP)2025.09 | 87.64 | 81.5 | 89.99 | 81.29 | 86.55 | 91.82 | 94.8 | 85.33 | 47.55 | |
| GPT-4oModel=GPT-4o2025.09 | 85.89 | 78.26 | 87.71 | 74.59 | 85.14 | 85.58 | 87.81 | 83.55 | 51.53 | |
| Grok-2Model=Grok-22025.09 | 83.92 | 76.24 | 85.61 | 76.18 | 82.02 | 82.63 | 88.84 | 77.39 | 51.31 | |
| Claude-3.5HModel=Claude-3.5H2025.09 | 82.07 | 71.2 | 84.72 | 71.49 | 77.74 | 77.95 | 81.19 | 73.68 | 48.52 | |
| Qwen-PlusModel=Qwen-Plus2025.09 | 80.32 | 72.36 | 82.97 | 73.42 | 81.49 | 81.18 | 86.99 | 76.27 | 51.64 | |
| DeepSeek-chatModel=DeepSeek-chat2025.09 | 77.63 | 72.02 | 81.53 | 72.96 | 79.64 | 79.81 | 72.23 | 78.05 | 47.83 | |
| Claude-3.7SModel=Claude-3.7S2025.09 | 77.43 | 70.51 | 79.24 | 72.39 | 77.41 | 79.49 | 62.34 | 72.56 | 47.76 | |
| GPT-4.5pModel=GPT-4.5p2025.09 | 72.86 | 71.46 | 76.67 | 72.78 | 77.18 | 77.68 | 82.5 | 82.59 | 50.63 | |
| Llama-3.3Model=Llama-3.32025.09 | 72.14 | 63.86 | 75.33 | 67.13 | 71.23 | 73.87 | 87.43 | 72.77 | 48.64 | |
| Gemini-2.0Model=Gemini-2.02025.09 | 67.26 | 61.61 | 74.96 | 65.73 | 70.72 | 71.6 | 49.77 | 75.17 | 42.11 |