Scientific Reasoning on GPQA Diamond (Avg@4)
52.02Avg@4 AccuracyReQueR
Evaluation Results
| Method | Links | |
|---|---|---|
| ReQueRModel=Qwen2.5-72B-Instruct, Temperature=0.62026.04 | 52.02 | |
| CoTModel=Qwen2.5-72B-Instruct, Temperature=0.62026.04 | 50.88 | |
| ReQueRModel=Llama-3.1-70B-Instruct, Temperature=0.62026.04 | 48.36 | |
| CoTModel=Llama-3.1-70B-Instruct, Temperature=0.62026.04 | 47.73 | |
| ReQueRModel=Qwen3-8B, Temperature=0.62026.04 | 45.45 | |
| CoTModel=Qwen3-8B, Temperature=0.62026.04 | 41.92 | |
| ReQueRModel=Qwen3-1.7B, Temperature=0.62026.04 | 32.83 | |
| ReQueRModel=Llama-3.1-8B-Instruct, Temperature=0.62026.04 | 31.31 | |
| CoTModel=Qwen3-1.7B, Temperature=0.62026.04 | 31.31 | |
| ReQueRModel=Mixtral-8x7B-Instruct, Temperature=0.62026.04 | 31.31 | |
| ReQueRModel=Llama-3.2-3B-Instruct, Temperature=0.62026.04 | 30.3 | |
| ReQueRModel=Qwen3-0.6B, Temperature=0.62026.04 | 30.3 | |
| CoTModel=Llama-3.1-8B-Instruct, Temperature=0.62026.04 | 27.78 | |
| CoTModel=Qwen3-0.6B, Temperature=0.62026.04 | 27.53 | |
| CoTModel=Llama-3.2-3B-Instruct, Temperature=0.62026.04 | 26.77 | |
| ReQueRModel=DS-MoE-16B-Chat, Temperature=0.62026.04 | 26.77 | |
| CoTModel=Mixtral-8x7B-Instruct, Temperature=0.62026.04 | 25.76 | |
| CoTModel=DS-MoE-16B-Chat, Temperature=0.62026.04 | 24.75 |