Constrained Path Planning on Textualized Gridworld Short targets (test)
56Success RateSAE-opt-anch
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SAE-opt-anchModel=Qwen3-4B-Instruct2026.05 | 56 | 23.4 | |
| SAE-optModel=Qwen3-4B-Instruct2026.05 | 55.5 | 21 | |
| SAE-SSVModel=Qwen3-4B-Instruct2026.05 | 54.8 | 24.7 | |
| Dense-optModel=Qwen3-4B-Instruct2026.05 | 54 | 26.7 | |
| CAAModel=Qwen3-4B-Instruct2026.05 | 53.9 | 38.8 | |
| SAE-optModel=LLaMA3.1-8B-Instruct2026.05 | 40.4 | 43 | |
| Dense-optModel=LLaMA3.1-8B-Instruct2026.05 | 39.9 | 48 | |
| CAAModel=LLaMA3.1-8B-Instruct2026.05 | 39.8 | 38.8 | |
| SAE-SSVModel=LLaMA3.1-8B-Instruct2026.05 | 39.5 | 46.5 | |
| SAE-opt-anchModel=LLaMA3.1-8B-Instruct2026.05 | 39.5 | 47.7 | |
| ITIModel=LLaMA3.1-8B-Instruct2026.05 | 39.2 | 67.5 | |
| SAE-optModel=Phi-3-Mini-4K-Instruct2026.05 | 38.9 | 54.2 | |
| ITIModel=Phi-3-Mini-4K-Instruct2026.05 | 38.8 | 39.9 | |
| CAAModel=Phi-3-Mini-4K-Instruct2026.05 | 38.6 | 36.4 | |
| Dense-optModel=Phi-3-Mini-4K-Instruct2026.05 | 38 | 54.7 | |
| SAE-opt-anchModel=Phi-3-Mini-4K-Instruct2026.05 | 37.4 | 56.1 | |
| SAE-SSVModel=Phi-3-Mini-4K-Instruct2026.05 | 35.8 | 55 | |
| ITIModel=Qwen3-4B-Instruct2026.05 | 32.9 | 57.8 | |
| ICLModel=Qwen3-4B-Instruct2026.05 | 29.3 | 57.1 | |
| ICLModel=LLaMA3.1-8B-Instruct2026.05 | 26.9 | 52.1 | |
| ICLModel=Phi-3-Mini-4K-Instruct2026.05 | 12.1 | 81.3 |