One-step next-observation prediction on SciWorld (test)
96Token F1Word2World
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Word2WorldBackbone=Qwen3.5-4B, LLM Usage=SFT, Infer. LLM?=Yes2026.05 | 96 | 95 | |
| PatchWorld-ResidualBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 69 | 56 | |
| PatchWorld-SimpleBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 57 | 39 | |
| PatchWorld-ResidualBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 56 | 48 | |
| PatchWorld-ResidualBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 56 | 46 | |
| LLM-DirectBackbone=DeepSeek-V4-Flash, LLM Usage=ICL, Infer. LLM?=Yes2026.05 | 52 | 34 | |
| LLM-DirectBackbone=Qwen3-Coder-480B, LLM Usage=ICL, Infer. LLM?=Yes2026.05 | 48 | 30 | |
| PatchWorld-SimpleBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 48 | 30 | |
| LLM-DirectBackbone=Mimo-v2.5, LLM Usage=ICL, Infer. LLM?=Yes2026.05 | 45 | 25 | |
| WorldCoderBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 41 | 33 | |
| PoE-WorldBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 41 | 36 | |
| WorldCoderBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 40 | 36 | |
| PoE-WorldBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 39 | 34 | |
| WorldCoderBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 37 | 33 | |
| PatchWorld-SimpleBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 22 | 4 | |
| PoE-WorldBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 21 | 21 |