One-step next-observation prediction on BabyAI (test)
93Token F1Word2World
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Word2WorldBackbone=Qwen3.5-4B, LLM Usage=SFT, Infer. LLM?=Yes2026.05 | 93 | 75 | |
| PatchWorld-SimpleBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 85 | 58 | |
| LLM-DirectBackbone=Mimo-v2.5, LLM Usage=ICL, Infer. LLM?=Yes2026.05 | 81 | 54 | |
| LLM-DirectBackbone=DeepSeek-V4-Flash, LLM Usage=ICL, Infer. LLM?=Yes2026.05 | 81 | 56 | |
| PatchWorld-ResidualBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 80 | 56 | |
| WorldCoderBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 78 | 61 | |
| PoE-WorldBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 78 | 62 | |
| PoE-WorldBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 78 | 62 | |
| WorldCoderBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 77 | 61 | |
| PatchWorld-SimpleBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 77 | 51 | |
| LLM-DirectBackbone=Qwen3-Coder-480B, LLM Usage=ICL, Infer. LLM?=Yes2026.05 | 73 | 44 | |
| PoE-WorldBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 73 | 54 | |
| WorldCoderBackbone=DeepSeek-V4-Flash, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 70 | 54 | |
| PatchWorld-ResidualBackbone=Qwen3-Coder-480B, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 69 | 47 | |
| PatchWorld-ResidualBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 49 | 28 | |
| PatchWorld-SimpleBackbone=Mimo-v2.5, LLM Usage=CodeGen, Infer. LLM?=No2026.05 | 41 | 19 |