Reasoning Accuracy on BBH
76.7Accuracy (BBH)Qurating
Evaluation Results
| Method | Links | |
|---|---|---|
| QuratingBase Model=OpenR1-Distill-7B2026.06 | 76.7 | |
| Random BaselineBase Model=OpenR1-Distill-7B2026.06 | 76.52 | |
| LESSBase Model=OpenR1-Distill-7B2026.06 | 76.15 | |
| DRIFTBase Model=OpenR1-Distill-7B2026.06 | 76.11 | |
| OpenR1-Distill-7BBase Model=OpenR1-Distill-7B2026.06 | 76.04 | |
| RDSBase Model=OpenR1-Distill-7B2026.06 | 75.88 | |
| BM25Base Model=OpenR1-Distill-7B2026.06 | 75.76 | |
| IF (Impl. w. GraSS)Base Model=OpenR1-Distill-7B2026.06 | 75.46 | |
| DSIRBase Model=OpenR1-Distill-7B2026.06 | 73.86 | |
| iLLaDA 8BModel Architecture=Diffusion, Training tokens=12T2026.06 | 71.3 | |
| Qwen2.5 7BModel Architecture=AR, Training tokens=18T2026.06 | 63.9 | |
| Self-DistillationBase Model=OpenR1-Distill-7B2026.06 | 60.82 | |
| Dream 7BModel Architecture=Diffusion, Training tokens=18T + 0.6T2026.06 | 57.9 | |
| K2V-7B-QwenSetting=zero-shot, Temperature=0.6, Evaluations=Average of 4, Algorithm=DAPO2026.05 | 55.36 | |
| LLaDA 8BModel Architecture=Diffusion, Training tokens=2.3T2026.06 | 49.7 | |
| Qwen2.5-7B-InstructSetting=zero-shot, Temperature=0.6, Evaluations=Average of 42026.05 | 49.63 | |
| DRIFTBase Model=Olmo3-7B-Instruct-SFT2026.06 | 45.61 | |
| BM25Base Model=Olmo3-7B-Instruct-SFT2026.06 | 44.88 | |
| Olmo3-7B-Instruct-SFTBase Model=Olmo3-7B-Instruct-SFT2026.06 | 44.63 | |
| QuratingBase Model=Olmo3-7B-Instruct-SFT2026.06 | 44.49 | |
| IF (Impl. w. GraSS)Base Model=Olmo3-7B-Instruct-SFT2026.06 | 44.49 | |
| Random BaselineBase Model=Olmo3-7B-Instruct-SFT2026.06 | 44.15 | |
| Self-DistillationBase Model=Olmo3-7B-Instruct-SFT2026.06 | 43.89 | |
| RDSBase Model=Olmo3-7B-Instruct-SFT2026.06 | 43.62 | |
| LESSBase Model=Olmo3-7B-Instruct-SFT2026.06 | 43.48 | |
| K2V-3B-QwenSetting=zero-shot, Temperature=0.6, Evaluations=Average of 4, Algorithm=DAPO2026.05 | 42.64 | |
| DSIRBase Model=Olmo3-7B-Instruct-SFT2026.06 | 40.18 | |
| Qwen2.5-3B-InstructSetting=zero-shot, Temperature=0.6, Evaluations=Average of 42026.05 | 37.21 |