General Reasoning on AutoLogi
90.5AccuracyTeamTR (Homogeneous)
Evaluation results
| Method | Links | |
|---|---|---|
| TeamTR (Homogeneous)Size=3×8B2026.05 | 90.5 | |
| Qwen3-Base SATSize=3×4B2026.04 | 89.1 | |
| TeamTR (Heterogeneous)Size=1.7B+8B+14B2026.05 | 88.7 | |
| Qwen3-A3BSize=30B2026.04 | 88.1 | |
| Qwen3-A3BSize=30B2026.05 | 88.1 | |
| Qwen3 (thinking)Size=32B2026.04 | 87.3 | |
| Qwen3 (thinking)Size=32B2026.05 | 87.3 | |
| QwQSize=32B2026.04 | 86.3 | |
| OpenAI o3-mini (medium)Size=/2026.04 | 86.3 | |
| o4-miniSize=–2026.05 | 86.3 | |
| QwQSize=32B2026.05 | 86.3 | |
| Qwen3-Base Debate + JudgeSize=3×8B2026.04 | 85.9 | |
| Debate + JudgeSize=3×8B2026.05 | 85.9 | |
| Qwen3-Base Role-playSize=3×8B2026.04 | 85.5 | |
| Role-playSize=3×8B2026.05 | 85.5 | |
| Qwen3-Base DebateSize=3×8B2026.04 | 85.1 | |
| DebateSize=3×8B2026.05 | 85.1 | |
| Llama 3.1-Base SATSize=3×8B2026.04 | 83.9 | |
| DeepSeek-R1 Distill LlamaSize=70B2026.04 | 83.5 | |
| DeepSeek-R1 DistillSize=70B2026.05 | 83.5 | |
| Qwen3-Base-DAPOSize=8B2026.04 | 80.9 | |
| DAPOSize=8B2026.05 | 80.9 | |
| Qwen3-Base-GRPOSize=8B2026.04 | 80.3 | |
| GRPOSize=8B2026.05 | 80.3 | |
| Qwen3-BaseSize=14B2026.04 | 79.1 | |
| Qwen3-BaseSize=32B2026.04 | 78.5 | |
| Qwen2.5-BaseSize=72B2026.04 | 76.7 | |
| GPT-4o-mini-2024-07-18Size=/2026.04 | 62.5 | |
| GPT-4o-miniSize=–2026.05 | 62.5 |