Physical Reasoning on Cut the Rope
26.14Success RateClaude 4.0 Opus
Evaluation Results
| Method | Links | |
|---|---|---|
| Claude 4.0 OpusPolicy Model=Claude 4.0 Opus, World Model=-2026.03 | 26.14 | |
| Claude 4.0 OpusPolicy Model=Claude 4.0 Opus, World Model=Claude 4.0 Opus2026.03 | 23.86 | |
| Gemini-2.5-ProPolicy Model=Gemini-2.5-Pro, World Model=-2026.03 | 22.73 | |
| Qwen-7B^P&I GRPOPolicy Model=Qwen-7B^P&I GRPO, World Model=Qwen-7B^P&I2026.03 | 21.2 | |
| Gemini-2.5-ProPolicy Model=Gemini-2.5-Pro, World Model=Gemini-2.5-Pro2026.03 | 20.45 | |
| Qwen-7B^P&I SFTPolicy Model=Qwen-7B^P&I SFT, World Model=Qwen-7B^P&I2026.03 | 19.33 | |
| Qwen-7B^P GRPOPolicy Model=Qwen-7B^P GRPO, World Model=Qwen-7B^P2026.03 | 18.88 | |
| GPT-o3Policy Model=GPT-o3, World Model=-2026.03 | 18.18 | |
| Qwen-7B^P SFTPolicy Model=Qwen-7B^P SFT, World Model=Qwen-7B^P2026.03 | 17.5 | |
| Qwen-7B^P&I GRPOPolicy Model=Qwen-7B^P&I GRPO, World Model=-2026.03 | 17.05 | |
| Qwen-7B^P&I SFTPolicy Model=Qwen-7B^P&I SFT, World Model=-2026.03 | 16.55 | |
| GPT-o3Policy Model=GPT-o3, World Model=GPT-o32026.03 | 16.5 | |
| Qwen-7B^P GRPOPolicy Model=Qwen-7B^P GRPO, World Model=-2026.03 | 16.1 | |
| Qwen-3B^P&I GRPOPolicy Model=Qwen-3B^P&I GRPO, World Model=Qwen-3B^P&I2026.03 | 15.8 | |
| Qwen-7B^P SFTPolicy Model=Qwen-7B^P SFT, World Model=-2026.03 | 15.35 | |
| Qwen-3B^P&I SFTPolicy Model=Qwen-3B^P&I SFT, World Model=Qwen-3B^P&I2026.03 | 14.05 | |
| Qwen-72BPolicy Model=Qwen-72B, World Model=-2026.03 | 13.64 | |
| Qwen-3B^P GRPOPolicy Model=Qwen-3B^P GRPO, World Model=Qwen-3B^P2026.03 | 12.98 | |
| Qwen-3B^P&I GRPOPolicy Model=Qwen-3B^P&I GRPO, World Model=-2026.03 | 12.1 | |
| Qwen-3B^P SFTPolicy Model=Qwen-3B^P SFT, World Model=Qwen-3B^P2026.03 | 11.85 | |
| Qwen-3B^P&I SFTPolicy Model=Qwen-3B^P&I SFT, World Model=-2026.03 | 11.6 | |
| Qwen-72BPolicy Model=Qwen-72B, World Model=Qwen-72B2026.03 | 11.5 | |
| MOCKPolicy Model=MOCK, World Model=-2026.03 | 11.36 | |
| Qwen-3B^P GRPOPolicy Model=Qwen-3B^P GRPO, World Model=-2026.03 | 11.05 | |
| Qwen-7B^I SFTPolicy Model=Qwen-7B^I SFT, World Model=Qwen-7B^I2026.03 | 10.36 | |
| Qwen-3B^P SFTPolicy Model=Qwen-3B^P SFT, World Model=-2026.03 | 10.23 | |
| Qwen-7B^I GRPOPolicy Model=Qwen-7B^I GRPO, World Model=Qwen-7B^I2026.03 | 10.15 | |
| Qwen-3B^I GRPOPolicy Model=Qwen-3B^I GRPO, World Model=Qwen-3B^I2026.03 | 9.88 | |
| Qwen-3B^I SFTPolicy Model=Qwen-3B^I SFT, World Model=Qwen-3B^I2026.03 | 9.13 | |
| Qwen-7BPolicy Model=Qwen-7B, World Model=-2026.03 | 9.09 | |
| Qwen-7B^I SFTPolicy Model=Qwen-7B^I SFT, World Model=-2026.03 | 8.21 | |
| Qwen-3BPolicy Model=Qwen-3B, World Model=-2026.03 | 7.95 | |
| Qwen-7B^I GRPOPolicy Model=Qwen-7B^I GRPO, World Model=-2026.03 | 7.95 | |
| Qwen-3B^I SFTPolicy Model=Qwen-3B^I SFT, World Model=-2026.03 | 7.8 | |
| Qwen-3B^I GRPOPolicy Model=Qwen-3B^I GRPO, World Model=-2026.03 | 7.75 | |
| Qwen-32BPolicy Model=Qwen-32B, World Model=-2026.03 | 6.82 |