Science Question Answering on GPQA Diamond (accuracy)
77AccuracyDeepseek-V3.2
Evaluation Results
| Method | Links | |
|---|---|---|
| Deepseek-V3.2Base Model=Deepseek-V3.22026.05 | 77 | |
| Kimi-K2.5Base Model=Kimi-K2.52026.05 | 76.4 | |
| Qwen3.5-9B + MaRBase Model=Qwen3.5-9B, Optimization Method=MaR2026.05 | 74.7 | |
| Qwen3.5-122BBase Model=Qwen3.5-122B2026.05 | 73.7 | |
| Qwen3.5-397BBase Model=Qwen3.5-397B2026.05 | 73.3 | |
| Qwen3.5-35BBase Model=Qwen3.5-35B2026.05 | 71.2 | |
| Qwen3.5-9B + DAPOBase Model=Qwen3.5-9B, Optimization Method=DAPO2026.05 | 71.1 | |
| Qwen3.5-4B + MaRBase Model=Qwen3.5-4B, Optimization Method=MaR2026.05 | 68.7 | |
| GLM-5.1Base Model=GLM-5.12026.05 | 67.5 | |
| Qwen3.5-9BBase Model=Qwen3.5-9B2026.05 | 67 | |
| Qwen3.5-4B + DAPOBase Model=Qwen3.5-4B, Optimization Method=DAPO2026.05 | 65.9 | |
| GPT-OSS-120BBase Model=GPT-OSS-120B2026.05 | 65.7 | |
| Qwen3.5-4BBase Model=Qwen3.5-4B2026.05 | 63.3 | |
| ReLATModel=Qwen3-14B2026.06 | 56.5 | |
| LatentMASModel=Qwen3-14B2026.06 | 52 | |
| TextMASModel=Qwen3-14B2026.06 | 51.5 | |
| SingleModel=Qwen3-14B2026.06 | 48.5 | |
| ReLATModel=Qwen3-8B2026.06 | 48 | |
| LatentMASModel=Qwen3-8B2026.06 | 45.5 | |
| TextMASModel=Qwen3-8B2026.06 | 43.4 | |
| ReLATModel=Qwen3-4B2026.06 | 42.4 | |
| LatentMASModel=Qwen3-4B2026.06 | 41.9 | |
| TextMASModel=Qwen3-4B2026.06 | 40.4 | |
| SingleModel=Qwen3-8B2026.06 | 39.9 | |
| ReLATModel=DeepSeek-R1-Distill-Qwen-7B2026.06 | 37.9 | |
| SingleModel=Qwen3-4B2026.06 | 36.3 | |
| TextMASModel=DeepSeek-R1-Distill-Qwen-7B2026.06 | 35.3 | |
| LatentMASModel=DeepSeek-R1-Distill-Qwen-7B2026.06 | 29.3 | |
| evaluation-instructed prompt optimizationBackbone=LLaMA-3, Optimization Type=Query-dependent2025.11 | 29 | |
| Pro-RefineBackbone=LLaMA-3.1, Optimization Type=Query-dependent2025.11 | 29 | |
| LLM onlyBackbone=LLaMA-3, Optimization Type=None2025.11 | 28 | |
| Pro-RefineBackbone=LLaMA-3, Optimization Type=Query-dependent2025.11 | 28 | |
| SingleModel=DeepSeek-R1-Distill-Qwen-7B2026.06 | 27.7 | |
| APEBackbone=LLaMA-3, Optimization Type=Template2025.11 | 27 | |
| evaluation-instructed prompt optimizationBackbone=LLaMA-3.1, Optimization Type=Query-dependent2025.11 | 27 | |
| TextGradBackbone=LLaMA-3.1, Optimization Type=Template2025.11 | 27 | |
| Self-RefineBackbone=LLaMA-3, Optimization Type=Query-dependent2025.11 | 26 | |
| TextGradBackbone=LLaMA-3, Optimization Type=Template2025.11 | 26 | |
| LLM onlyBackbone=LLaMA-3.1, Optimization Type=None2025.11 | 26 | |
| Self-RefineBackbone=LLaMA-3.1, Optimization Type=Query-dependent2025.11 | 26 | |
| APEBackbone=LLaMA-3.1, Optimization Type=Template2025.11 | 24 | |
| evaluation-instructed prompt optimizationBackbone=GPT-4o, Optimization Type=Query-dependent2025.11 | 24 | |
| TextGradBackbone=GPT-4o, Optimization Type=Template2025.11 | 23 | |
| LLM onlyBackbone=GPT-4o, Optimization Type=None2025.11 | 22 | |
| APEBackbone=GPT-4o, Optimization Type=Template2025.11 | 22 | |
| Pro-RefineBackbone=GPT-4o, Optimization Type=Query-dependent2025.11 | 21 | |
| Self-RefineBackbone=GPT-4o, Optimization Type=Query-dependent2025.11 | 20 |