One-step next-observation prediction on AgentGym Unweighted Average (test)
85Token F1Word2World
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Word2WorldBackbone=Qwen3.5-4B, LLM Usage=SFT, Infer. LLM?=Yes2026.05 | 85 | 67 | |
| PatchWorld-ResidualBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 70 | 49 | |
| PatchWorld-ResidualBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 70 | 50 | |
| PatchWorld-ResidualBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 69 | 50 | |
| LLM-DirectBackbone=DeepSeek-V4-Flash, LLM Usage=ICL, Infer. LLM?=Yes2026.05 | 66 | 43 | |
| PoE-WorldBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 65 | 49 | |
| LLM-DirectBackbone=Qwen3-Coder-480B, LLM Usage=ICL, Infer. LLM?=Yes2026.05 | 64 | 41 | |
| LLM-DirectBackbone=Mimo-v2.5, LLM Usage=ICL, Infer. LLM?=Yes2026.05 | 63 | 41 | |
| WorldCoderBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 63 | 48 | |
| WorldCoderBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 63 | 46 | |
| PoE-WorldBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 63 | 47 | |
| PatchWorld-SimpleBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 60 | 38 | |
| PatchWorld-SimpleBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 60 | 38 | |
| WorldCoderBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 57 | 39 | |
| PatchWorld-SimpleBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 57 | 34 | |
| PoE-WorldBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 51 | 35 |