General Reasoning on General Reasoning Suite Average
78.3Pass@1GPT-5.4-xhigh
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5.4-xhighSize=—, # Reas. Tokens=4821.8, Reasoning Paradigm=Pretrained LLMs + Tools2026.05 | 78.3 | — | — | |
| MiroThinker-v1.5Size=30B, # Reas. Tokens=11295.2, Reasoning Paradigm=Unregulated Deliberation2026.05 | 74.2 | — | — | |
| DeepSeek-V3.2Size=685B, # Reas. Tokens=3011.5, Reasoning Paradigm=Pretrained LLMs + Tools2026.05 | 73.2 | — | — | |
| SR2AM-v1.0-30BSize=30B, # Reas. Tokens=5517.7, Reasoning Paradigm=Self-Regulated Simulative Reasoning2026.05 | 71.3 | — | — | |
| Kimi-K2.5Size=1024B, # Reas. Tokens=6413.1, Reasoning Paradigm=Pretrained LLMs + Tools2026.05 | 70.9 | — | — | |
| FP16Model=Qwen3-8B, Quantization Bits=FP162026.05 | 69.81 | — | — | |
| LAQuantModel=Qwen3-8B, Quantization Bits=4-bit, Group Size=128, Speedup=2.45×2026.05 | 68.62 | — | — | |
| GPT-5.4-xhighSize=—, # Reas. Tokens=8810.3, Reasoning Paradigm=Reasoning LLMs2026.05 | 68.4 | — | — | |
| FP16Model=Qwen3-4B, Quantization Bits=FP162026.05 | 66.4 | — | — | |
| LAQuantModel=Qwen3-4B, Quantization Bits=4-bit, Group Size=128, Speedup=2.0×2026.05 | 64.81 | — | — | |
| LAQuantModel=Qwen3-8B, Quantization Bits=3-bit, Group Size=128, Speedup=5.15×2026.05 | 64.28 | — | — | |
| LAQuantModel=Qwen3-8B, Quantization Bits=3-bit2026.05 | 64.28 | — | — | |
| DeepSeek-V3.2Size=685B, # Reas. Tokens=9306.2, Reasoning Paradigm=Reasoning LLMs2026.05 | 62.8 | — | — | |
| ParoQ++Model=Qwen3-8B, Quantization Bits=3-bit2026.05 | 62.1 | — | — | |
| GLM-4.6Size=357B, # Reas. Tokens=3580.4, Reasoning Paradigm=Pretrained LLMs + Tools2026.05 | 60.7 | — | — | |
| Tongyi-DeepResearchSize=30B, # Reas. Tokens=7431.8, Reasoning Paradigm=Unregulated Deliberation2026.05 | 60.6 | — | — | |
| GPT-OSS-120B-highSize=120B, # Reas. Tokens=2700.4, Reasoning Paradigm=Pretrained LLMs + Tools2026.05 | 60.3 | — | — | |
| ParoQModel=Qwen3-8B, Quantization Bits=3-bit2026.05 | 59.48 | — | — | |
| ASearcher-Web-QWQ-v2Size=32B, # Reas. Tokens=116752.9, Reasoning Paradigm=Unregulated Deliberation2026.05 | 59.2 | — | — | |
| LAQuantModel=Qwen3-4B, Quantization Bits=3-bit, Group Size=128, Speedup=3.42×2026.05 | 58.12 | — | — | |
| LAQuantModel=Qwen3-4B, Quantization Bits=3-bit2026.05 | 58.12 | — | — | |
| ParoQ++Model=Qwen3-4B, Quantization Bits=3-bit2026.05 | 57.2 | — | — | |
| Qwen3-235BSize=235B, # Reas. Tokens=6467.4, Reasoning Paradigm=Pretrained LLMs + Tools2026.05 | 57 | — | — | |
| SR2AM-v0.1-8BSize=8B, # Reas. Tokens=3697.6, Reasoning Paradigm=Self-Regulated Simulative Reasoning2026.05 | 57 | — | — | |
| R-QATModel=Qwen3-8B, Quantization Bits=3-bit2026.05 | 56 | — | — | |
| K2-Think-V2-highSize=73B, # Reas. Tokens=31905.2, Reasoning Paradigm=Reasoning LLMs2026.05 | 55.3 | — | — | |
| WebExplorer-8BSize=8B, # Reas. Tokens=3616.9, Reasoning Paradigm=Unregulated Deliberation2026.05 | 54.7 | — | — | |
| Qwen3-30B-A3BSize=30B, # Reas. Tokens=5410.1, Reasoning Paradigm=Pretrained LLMs + Tools2026.05 | 53.1 | — | — | |
| Qwen3-30B-A3BSize=30B, # Reas. Tokens=8269.1, Reasoning Paradigm=Reasoning LLMs2026.05 | 52.6 | — | — | |
| WebSailor-32BSize=32B, # Reas. Tokens=1055.2, Reasoning Paradigm=Unregulated Deliberation2026.05 | 51.8 | — | — | |
| A2FMSize=32B, # Reas. Tokens=23424.8, Reasoning Paradigm=Mode Routing2026.05 | 51.4 | — | — | |
| GPTQModel=Qwen3-8B, Quantization Bits=3-bit2026.05 | 51.15 | — | — | |
| ParoQModel=Qwen3-4B, Quantization Bits=3-bit2026.05 | 49.33 | — | — | |
| R-QATModel=Qwen3-4B, Quantization Bits=3-bit2026.05 | 48.91 | — | — | |
| FP16Model=R1-Distill-Llama-8B, Quantization Bits=FP162026.05 | 46.29 | — | — | |
| FP16Model=Qwen3-1.7B, Quantization Bits=FP162026.05 | 46.27 | — | — | |
| LAQuantModel=R1-Distill-Llama-8B, Quantization Bits=4-bit, Group Size=128, Speedup=2.46×2026.05 | 44.68 | — | — | |
| LAQuantModel=Qwen3-1.7B, Quantization Bits=4-bit, Group Size=128, Speedup=1.64×2026.05 | 43.8 | — | — | |
| LAQuantModel=R1-Distill-Llama-8B, Quantization Bits=3-bit, Group Size=128, Speedup=5.56×2026.05 | 39.54 | — | — | |
| LAQuantModel=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.05 | 39.54 | — | — | |
| SimpleTIR-32BSize=32B, # Reas. Tokens=5174.8, Reasoning Paradigm=Unregulated Deliberation2026.05 | 38.6 | — | — | |
| SASmax context length=4K, ratio r=0.32026.04 | 38.3 | 2,729 | 0.45 | |
| R-QATModel=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.05 | 37.8 | — | — | |
| LAPO-Imax context length=4K2026.04 | 37.77 | 3,331 | 0.27 | |
| ParoQ++Model=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.05 | 37.73 | — | — | |
| ThinkPrune-4kmax context length=4K2026.04 | 37.62 | 3,127 | 0.31 | |
| DeepScaleRmax context length=4K2026.04 | 37.44 | 4,416 | 0 | |
| L1-Maxmax context length=4K2026.04 | 37.22 | 2,242 | 0.46 | |
| LAQuantModel=Qwen3-1.7B, Quantization Bits=3-bit, Group Size=128, Speedup=2.29×2026.05 | 36.6 | — | — | |
| LAQuantModel=Qwen3-1.7B, Quantization Bits=3-bit2026.05 | 36.6 | — | — | |
| GRPO-4Kmax context length=4K2026.04 | 36.55 | 2,496 | 0.32 | |
| ParoQ++Model=Qwen3-1.7B, Quantization Bits=3-bit2026.05 | 34.54 | — | — | |
| WebSailor-7BSize=7B, # Reas. Tokens=2211.5, Reasoning Paradigm=Unregulated Deliberation2026.05 | 32.8 | — | — | |
| R-QATModel=Qwen3-1.7B, Quantization Bits=3-bit2026.05 | 32.55 | — | — | |
| GPTQModel=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.05 | 31.13 | — | — | |
| SimpleTIR-7BSize=7B, # Reas. Tokens=3551.7, Reasoning Paradigm=Unregulated Deliberation2026.05 | 30.9 | — | — | |
| AFM-Code-7B-RLSize=7B, # Reas. Tokens=11205.5, Reasoning Paradigm=Workflow Distillation2026.05 | 28.9 | — | — | |
| AFM-Web-7B-RLSize=7B, # Reas. Tokens=2608.6, Reasoning Paradigm=Workflow Distillation2026.05 | 27.5 | — | — | |
| GPTQModel=Qwen3-4B, Quantization Bits=3-bit2026.05 | 26.01 | — | — | |
| ParoQModel=Qwen3-1.7B, Quantization Bits=3-bit2026.05 | 24.57 | — | — | |
| ASearcher-Web-7BSize=7B, # Reas. Tokens=601.4, Reasoning Paradigm=Unregulated Deliberation2026.05 | 24.5 | — | — | |
| ParoQModel=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.05 | 18.17 | — | — | |
| GPTQModel=Qwen3-1.7B, Quantization Bits=3-bit2026.05 | 11.03 | — | — |