# TextArena

Source: [TextArena](<https://www.sota2.com/research/paper/68fa78c61e209131cea7a701>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T04:47:07.371Z

Authors: Leon Guertler, Bobby Cheng, Simon Yu, Bo Liu, Leshem Choshen, Cheston Tan

Published: 2025-04-15T17:55:20.000Z

## Abstract

TextArena is an open-source collection of competitive text-based games for training and evaluation of agentic behavior in Large Language Models (LLMs). It spans 57+ unique environments (including single-player, two-player, and multi-player setups) and allows for easy evaluation of model capabilities via an online-play system (against humans and other submitted models) with real-time TrueSkill scores. Traditional benchmarks rarely assess dynamic social skills such as negotiation, theory of mind, and deception, creating a gap that TextArena addresses. Designed with research, community and extensibility in mind, TextArena emphasizes ease of adding new games, adapting the framework, testing models, playing against the models, and training models. Detailed documentation of environments, games, leaderboard, and examples are available on https://github.com/LeonGuertler/TextArena and https://www.textarena.ai/.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Strategic Game Playing on TextArena SPIN-Bench](<https://www.sota2.com/research/sota/strategic-game-playing-on-textarena-spin-bench.md>): Strategic game playing; TextArena SPIN-Bench; Win Rate (Simple Negotiation): 31.3.

- [Multi-turn Strategic Gameplay on Multi-turn Game Suite](<https://www.sota2.com/research/sota/multi-turn-strategic-gameplay-on-multi-turn-game-suite.md>): Multi-turn Strategic Gameplay; Multi-turn Game Suite (SimpleNegotiation, TwoDollar, KuhnPoker, Briscola, SimpleTak); SimpleNegotiation Win Rate: 31.3.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2504.11442>)

[PDF](<https://arxiv.org/pdf/2504.11442.pdf>)