Urban Path Generation on Melb 88 POIs
96TraversabilityCOMPASSLLM
Evaluation Results
| Method | Links | |
|---|---|---|
| COMPASSLLMType=LLM based, Underlying Model=GPT 4o2025.10 | 96 | |
| NMLRType=DL2025.10 | 95 | |
| COMPASSLLMType=LLM based, Underlying Model=GPT o3 mini2025.10 | 95 | |
| APEType=LLM based, Underlying Model=GPT 4o2025.10 | 94 | |
| ReflexionType=LLM based, Underlying Model=GPT o3 mini2025.10 | 91 | |
| LLM A*Type=LLM based, Underlying Model=GPT 4o2025.10 | 90 | |
| LLM A*Type=LLM based, Underlying Model=GPT o3 mini2025.10 | 90 | |
| ReflexionType=LLM based, Underlying Model=GPT 4o2025.10 | 88 | |
| APEType=LLM based, Underlying Model=GPT o3 mini2025.10 | 88 | |
| ReActType=LLM based, Underlying Model=GPT 4o2025.10 | 86 | |
| ReActType=LLM based, Underlying Model=GPT o3 mini2025.10 | 81 | |
| ReflexionType=LLM based, Underlying Model=Llama 3.1 8b2025.10 | 78 | |
| PathGPTType=LLM based, Underlying Model=GPT o3 mini2025.10 | 71 | |
| ReActType=LLM based, Underlying Model=Llama 3.1 8b2025.10 | 63 | |
| COMPASSLLMType=LLM based, Underlying Model=Llama 3.1 8b2025.10 | 61 | |
| CoTType=LLM based, Underlying Model=GPT o3 mini2025.10 | 56 | |
| DirectType=LLM based, Underlying Model=GPT o3 mini2025.10 | 53 | |
| SCType=LLM based, Underlying Model=GPT o3 mini2025.10 | 53 | |
| LLM A*Type=LLM based, Underlying Model=Llama 3.1 8b2025.10 | 49 | |
| PathGPTType=LLM based, Underlying Model=GPT 4o2025.10 | 43 | |
| APEType=LLM based, Underlying Model=Llama 3.1 8b2025.10 | 42 | |
| DirectType=LLM based, Underlying Model=GPT 4o2025.10 | 33 | |
| SCType=LLM based, Underlying Model=GPT 4o2025.10 | 22 | |
| SCType=LLM based, Underlying Model=Llama 3.1 8b2025.10 | 21 | |
| CoTType=LLM based, Underlying Model=GPT 4o2025.10 | 20 | |
| CoTType=LLM based, Underlying Model=Llama 3.1 8b2025.10 | 19 | |
| DirectType=LLM based, Underlying Model=Llama 3.1 8b2025.10 | 17 | |
| PathGPTType=LLM based, Underlying Model=Llama 3.1 8b2025.10 | 17 |