Logic Reasoning on ZebraLogic
0.817Avg Accuracy @1NPR
Evaluation results
| Method | Links | |
|---|---|---|
| NPRData=orz-8k, Train=Parallel RL, Base=NPR-BETA2025.12 | 0.817 | |
| Qwen3-4B-Instruct-2507Data=N/A, Train=N/A, Base=N/A2025.12 | 0.802 | |
| SRData=orz-8k, Train=Sequential RL, Base=NPR-BETA2025.12 | 0.789 | |
| NPR-BETAData=orz-8k, Train=Parallel SFT, Base=Q3-4B-Inst.2025.12 | 0.761 | |
| NPR (Variant)Data=orz-8k, Train=Parallel RL, Base=NPR-BETA2025.12 | 0.758 | |
| SR-BETAData=orz-8k, Train=Sequential SFT, Base=Q3-4B-Inst.2025.12 | 0.728 | |
| NPR-BETA (Variant)Data=orz-8k, Train=Parallel SFT, Base=Q3-4B2025.12 | 0.7 | |
| Multiverse-4BData=s1.1-8k, Train=S→P SFT, Base=Q3-4B-Inst.2025.12 | 0.602 | |
| Multiverse-32BData=s1.1-8k, Train=S→P SFT, Base=Q2.5-32B-Inst.2025.12 | 0.471 | |
| Qwen2.5-32B-InstructData=N/A, Train=N/A, Base=N/A2025.12 | 0.436 | |
| Qwen3-4B (Non-Thinking)Data=N/A, Train=N/A, Base=N/A2025.12 | 0.352 |