Travel Planning on TravelPlanner 1000 tasks (test)
94.72Commonsense Score (Micro)HiMAP-Travel
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| HiMAP-TravelBackbone=Qwen3-4B2026.03 | 94.72 | — | 66.03 | 46.44 | 63.45 | 49.8 | |
| HiMAP-TravelBackbone=Qwen3-8B2026.03 | 94.62 | — | 67 | 50.47 | 66.05 | 52.65 | |
| DeepTravelBackbone=Qwen3-8B2026.03 | 93.28 | — | 60.62 | 45.66 | 60.12 | 43.98 | |
| AutoRefineAugmentation=ReAct2026.01 | 91.73 | 100 | 42.2 | 42.1 | 37.2 | 34.1 | |
| MTPBackbone=GPT-4 w/ hint2026.03 | 91.46 | — | 50 | 53.96 | 45.12 | 42.68 | |
| DeepTravelBackbone=Qwen3-4B2026.03 | 90.62 | — | 53.85 | 39.5 | 52.33 | 34.92 | |
| AutoRefine2026.01 | 90.59 | 99.9 | 37.9 | 37.16 | 32.6 | 27.1 | |
| ATLASBackbone=Gemini-2.5-Pro2026.03 | 85.81 | — | 40.5 | 77.64 | 70.6 | 35 | |
| ReAct2026.01 | 75.26 | 99.2 | 16.5 | 49.04 | 39.1 | 10.4 | |
| PMC2026.01 | 73.89 | 100 | 15.59 | 45.19 | 33.56 | 12.12 | |
| ATLAS2026.01 | 73.89 | 100 | 15.59 | 45.19 | 33.56 | 12.12 | |
| ReActAugmentation=Reflexion2026.01 | 71.84 | 99.8 | 13.67 | 37.84 | 26.7 | 9.13 | |
| ReActAugmentation=EvoAgent2026.01 | 67.01 | 98.89 | 10 | 33.71 | 20.42 | 6.11 |