Task Success on SciWorld
68.21RealGPT-5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GPT-5World Model=Qwen2.5-7B WorldModel2025.12 | 68.21 | 64.1 | 61.03 | 0.89 | |
| GPT-5World Model=Llama3.1-8B WorldModel2025.12 | 68.21 | 63.07 | 57.44 | 0.84 | |
| Claude-sonnet-4.5World Model=Qwen2.5-7B WorldModel2025.12 | 66 | 45.64 | 57.95 | 0.88 | |
| Claude-sonnet-4.5World Model=Llama3.1-8B WorldModel2025.12 | 66 | 58.46 | 53.33 | 0.81 | |
| Gemini-2.5-flashWorld Model=Qwen2.5-7B WorldModel2025.12 | 56 | 39.49 | 45.64 | 0.82 | |
| Gemini-2.5-flashWorld Model=Llama3.1-8B WorldModel2025.12 | 56 | 57.95 | 52.31 | 0.93 | |
| GPT-4.1World Model=Qwen2.5-7B WorldModel2025.12 | 43.41 | 45.79 | 46.32 | 1.07 | |
| GPT-4.1World Model=Llama3.1-8B WorldModel2025.12 | 43.41 | 45.13 | 35.38 | 0.82 | |
| GPT-4-turboWorld Model=Qwen2.5-7B WorldModel2025.12 | 36.79 | 50 | 36.6 | 0.99 | |
| GPT-4-turboWorld Model=Llama3.1-8B WorldModel2025.12 | 36.79 | 52.31 | 44.1 | 1.2 | |
| GPT-4oWorld Model=Qwen2.5-7B WorldModel2025.12 | 34.97 | 37.63 | 31.44 | 0.9 | |
| GPT-4oWorld Model=Llama3.1-8B WorldModel2025.12 | 34.97 | 37.63 | 32.99 | 0.94 | |
| GPT-4o-miniWorld Model=Qwen2.5-7B WorldModel2025.12 | 12.64 | 12.04 | 8.9 | 0.7 | |
| GPT-4o-miniWorld Model=Llama3.1-8B WorldModel2025.12 | 12.64 | 10.78 | 8.21 | 0.65 |