One-step next-observation prediction on WebShop (test)
63Token F1Word2World
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Word2WorldBackbone=Qwen3.5-4B, LLM Usage=SFT, Infer. LLM?=Yes2026.05 | 63 | 42 | |
| PoE-WorldBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 60 | 47 | |
| LLM-DirectBackbone=DeepSeek-V4-Flash, LLM Usage=ICL, Infer. LLM?=Yes2026.05 | 58 | 36 | |
| WorldCoderBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 58 | 45 | |
| WorldCoderBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 58 | 45 | |
| PoE-WorldBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 58 | 44 | |
| LLM-DirectBackbone=Qwen3-Coder-480B, LLM Usage=ICL, Infer. LLM?=Yes2026.05 | 56 | 34 | |
| WorldCoderBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 53 | 37 | |
| PatchWorld-SimpleBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 53 | 30 | |
| LLM-DirectBackbone=Mimo-v2.5, LLM Usage=ICL, Infer. LLM?=Yes2026.05 | 52 | 25 | |
| PatchWorld-ResidualBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 50 | 26 | |
| PatchWorld-ResidualBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 50 | 26 | |
| PatchWorld-ResidualBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 50 | 26 | |
| PoE-WorldBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 47 | 33 | |
| PatchWorld-SimpleBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 28 | 12 | |
| PatchWorld-SimpleBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 28 | 10 |