Travel Itinerary Retrieval and Ranking on Travel Itinerary 200 city-related queries (test)
89.5Top-5 Success RateCORE (Reasoning)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CORE (Reasoning)LLM=Claude-4, Optimization Strategy=Reasoning2026.02 | 89.5 | 83.5 | 76 | |
| CORE (Reasoning)LLM=GPT-4o, Optimization Strategy=Reasoning2026.02 | 87.5 | 82 | 75.5 | |
| CORE (Review)LLM=Claude-4, Optimization Strategy=Review2026.02 | 86 | 80.5 | 73.5 | |
| CORE (Review)LLM=Gemini-2.5, Optimization Strategy=Review2026.02 | 85 | 79.5 | 72.5 | |
| CORE (Reasoning)LLM=Gemini-2.5, Optimization Strategy=Reasoning2026.02 | 84 | 78 | 71 | |
| CORE (Review)LLM=GPT-4o, Optimization Strategy=Review2026.02 | 83.5 | 78 | 71.5 | |
| CORE (Reasoning)LLM=Grok-3, Optimization Strategy=Reasoning2026.02 | 82.5 | 76 | 69 | |
| CORE (Review)LLM=Grok-3, Optimization Strategy=Review2026.02 | 81 | 75 | 68.5 | |
| CORE (String)LLM=Claude-4, Optimization Strategy=String2026.02 | 55 | 44.5 | 30.5 | |
| CORE (String)LLM=GPT-4o, Optimization Strategy=String2026.02 | 53.5 | 43 | 30 | |
| CORE (String)LLM=Gemini-2.5, Optimization Strategy=String2026.02 | 51 | 41 | 28.5 | |
| CORE (String)LLM=Grok-3, Optimization Strategy=String2026.02 | 49.5 | 39.5 | 27 |