# GTO Wizard Benchmark

Source: [GTO Wizard Benchmark](<https://www.sota2.com/research/paper/69c4bd6b0636e5bf4afc7494>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-27T05:00:04.194Z

Authors: Marc-Antoine Provost, Nejc Ilenic, Christopher Solinas, Philippe Beardsell

Published: 2026-03-24T19:04:04.000Z

## Abstract

We introduce GTO Wizard Benchmark, a public API and standardized evaluation framework for benchmarking algorithms in Heads-Up No-Limit Texas Hold'em (HUNL). The benchmark evaluates agents against GTO Wizard AI, a state-of-the-art superhuman poker agent that approximates Nash Equilibria, and defeated Slumbot, the 2018 Annual Computer Poker Competition champion and previous strongest publicly accessible HUNL benchmark, by $19.4$ $\\pm$ $4.1$ bb/100. Variance is a fundamental challenge in poker evaluation; we address this by integrating AIVAT, a provably unbiased variance reduction technique that achieves equivalent statistical significance with ten times fewer hands than naive Monte Carlo evaluation. We conduct a comprehensive benchmarking study of state-of-the-art large language models under zero-shot conditions, including GPT-5.4, Claude Opus 4.6, Gemini 3.1 Pro, Grok 4, and others. Initial results and analysis reveal dramatic progress in LLM reasoning over recent years, yet all models remain far below the baseline established by our benchmark. Qualitative analysis reveals clear opportunities for improvement, including representation and the ability to reason over hidden states. This benchmark provides researchers with a precise and quantifiable setting to evaluate advances in planning and reasoning in multi-agent systems with partial observability.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Heads-up No-Limit Texas Hold'em on GTOWizard HUNL](<https://www.sota2.com/research/sota/heads-up-no-limit-texas-hold-em-on-gtowizard-hunl.md>): Heads-Up No-Limit Texas Hold'em; GTOWizard HUNL; BB/h: 223.

- [Heads-Up No-Limit Hold'em (HUNL) on GTOWizard benchmark](<https://www.sota2.com/research/sota/heads-up-no-limit-hold-em-hunl-on-gtowizard-benchmark.md>): Heads-Up No-Limit Hold'em (HUNL); GTOWizard benchmark; mbb/h: 132.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2603.23660>)

[PDF](<https://arxiv.org/pdf/2603.23660.pdf>)