Popular Path Search on Epcot
79F1 ScoreCOMPASSLLM
Evaluation Results
| Method | Links | |
|---|---|---|
| COMPASSLLMType=LLM based, Base Model=GPT o3 mini2025.10 | 79 | |
| SCType=LLM based, Base Model=GPT o3 mini2025.10 | 76 | |
| ReflexionType=LLM based, Base Model=GPT o3 mini2025.10 | 75 | |
| APEType=LLM based, Base Model=GPT o3 mini2025.10 | 74 | |
| COMPASSLLMType=LLM based, Base Model=GPT 4o2025.10 | 73 | |
| DirectType=LLM based, Base Model=GPT o3 mini2025.10 | 73 | |
| CoTType=LLM based, Base Model=GPT o3 mini2025.10 | 73 | |
| ReActType=LLM based, Base Model=GPT o3 mini2025.10 | 73 | |
| LLM A*Type=LLM based, Base Model=GPT o3 mini2025.10 | 73 | |
| APEType=LLM based, Base Model=GPT 4o2025.10 | 71 | |
| ReActType=LLM based, Base Model=GPT 4o2025.10 | 70 | |
| ReflexionType=LLM based, Base Model=GPT 4o2025.10 | 70 | |
| NMLRType=ML/DL based2025.10 | 69 | |
| COMPASSLLMType=LLM based, Base Model=Llama 3.1 8b2025.10 | 69 | |
| ReActType=LLM based, Base Model=Llama 3.1 8b2025.10 | 64 | |
| ReflexionType=LLM based, Base Model=Llama 3.1 8b2025.10 | 64 | |
| PathGPTType=LLM based, Base Model=Llama 3.1 8b2025.10 | 61 | |
| PathGPTType=LLM based, Base Model=GPT o3 mini2025.10 | 61 | |
| NASRType=ML/DL based2025.10 | 60 | |
| MarkovType=ML/DL based2025.10 | 59 | |
| DeepAltTrip-LSTMType=ML/DL based2025.10 | 59 | |
| SCType=LLM based, Base Model=GPT 4o2025.10 | 59 | |
| DeepAltTrip-SampType=ML/DL based2025.10 | 58 | |
| CoTType=LLM based, Base Model=GPT 4o2025.10 | 57 | |
| LLM A*Type=LLM based, Base Model=GPT 4o2025.10 | 56 | |
| SCType=LLM based, Base Model=Llama 3.1 8b2025.10 | 55 | |
| CoTType=LLM based, Base Model=Llama 3.1 8b2025.10 | 53 | |
| LLM A*Type=LLM based, Base Model=Llama 3.1 8b2025.10 | 53 | |
| DirectType=LLM based, Base Model=GPT 4o2025.10 | 51 | |
| DirectType=LLM based, Base Model=Llama 3.1 8b2025.10 | 46 | |
| PathGPTType=LLM based, Base Model=GPT 4o2025.10 | 43 | |
| APEType=LLM based, Base Model=Llama 3.1 8b2025.10 | 40 |