List your company

Planning on Sokoban Grid

63Validity RateL-ICL
0.616.83349.2Jan 30, 2026

Evaluation results

MethodLinks
L-ICLNumber of training examples (m)=60, Input representation (ASCII grid)=true2026.016349
L-ICLNumber of training examples (m)=60, Input representation (ASCII grid)=false2026.016244
RAG-ICLContext size (characters)=20k, Input representation (ASCII grid)=true2026.012510
ReActInference feedback=Oracle feedback, Input representation (ASCII grid)=true2026.012113
L-ICLNumber of training examples (m)=0, Input representation (ASCII grid)=true2026.012117
ReActPrompting strategy=ReAct (Prompt-Only), Input representation (ASCII grid)=true2026.011912
RAG-ICLContext size (characters)=10k, Input representation (ASCII grid)=true2026.01174
Zero-ShotInput representation (ASCII grid)=true2026.01150
Self-RefineReasoning samples (k)=5, Input representation (ASCII grid)=true2026.01138
Self-ConsistencyReasoning samples (k)=5, Input representation (ASCII grid)=true2026.01105
L-ICLNumber of training examples (m)=0, Input representation (ASCII grid)=false2026.01108
ToTPrompting strategy=ToT (Prompt-Only), Input representation (ASCII grid)=true2026.0132