Revisit Consistency Evaluation on World Memory Evaluation
18.87Throughput (FPS) @ 4xH200Matrix-Game-2.0 (Sliding Window Original)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Matrix-Game-2.0 (Sliding Window Original)Memory Training=Without, Base Model=Matrix-Game-2.0, Number of Parameters=1.3B, KV Strategy=Sliding Window (Original)2026.05 | 18.87 | — | 59.4 | 11.422 | 28 | 157.261 | |
| Matrix-Game-2.0 (WorldKV)Memory Training=Without, Base Model=Matrix-Game-2.0, Number of Parameters=1.3B, KV Strategy=WorldKV2026.05 | 16.25 | — | 46.2 | 14.101 | 40.5 | 93.561 | |
| Yume-1.5Memory Training=With, Number of Parameters=5B2026.05 | 11.41 | — | 56.6 | 13.167 | 46.7 | 141.704 | |
| Matrix-Game-2.0 (Full KV)Memory Training=Without, Base Model=Matrix-Game-2.0, Number of Parameters=1.3B, KV Strategy=Full KV2026.05 | 7.82 | — | 52.9 | 13.748 | 36.4 | 124.912 | |
| LingBot-World-Fast (Sliding Window)Memory Training=Without, Base Model=LingBot-World-Fast, Number of Parameters=14B, KV Strategy=Sliding Window2026.05 | 5.05 | 8.1 | 58.1 | 12.184 | 37.5 | 144.036 | |
| WorldPlayMemory Training=With, Number of Parameters=8B2026.05 | 4.95 | — | 49.6 | 14.556 | 47 | 113.317 | |
| LingBot-World-Fast (WorldKV)Memory Training=Without, Base Model=LingBot-World-Fast, Number of Parameters=14B, KV Strategy=WorldKV2026.05 | 4.78 | 7.71 | 45.5 | 15.66 | 46.3 | 75.644 | |
| LingBot-World-Fast (Full KV Original)Memory Training=Without, Base Model=LingBot-World-Fast, Number of Parameters=14B, KV Strategy=Full KV (Original)2026.05 | 2.36 | 3.83 | 44.1 | 15.901 | 47.2 | 85.705 |