List your company
ResearchFormerly WizWand

Taxi Domain on Taxi Standard

83.98AccuracyOpenAI o4-mini
-2.142420.216342.57564.9337Nov 28, 2025
Updated 8mo ago

Evaluation results

MethodLinks
OpenAI o4-minicategory=Proprietary Models2025.1183.98
OpenAI o3category=Proprietary Models2025.1172.66
Claude 4.5 Sonnetcategory=Proprietary Models2025.1166.41
WMAct2025.1162.16
PPO - Interactivemode=interactive2025.1139.16
PPO - EntirePlanmode=single-turn output2025.1138.92
GPT-5category=Proprietary Models2025.1136.72
Gemini 2.5 Procategory=Proprietary Models2025.1117.97
Qwen3-8Bcategory=Opensource Models2025.119.38
Qwen3-14Bcategory=Opensource Models2025.116.64
GPT-4ocategory=Proprietary Models2025.116.25
Qwen3-8B-Ownbackbone=Qwen3-8B2025.115.6
Qwen2.5-32B-Instructcategory=Opensource Models2025.112.34
Qwen2.5-7B-Instructcategory=Opensource Models2025.111.17