# U2-Bench

Source: [U2-Bench](<https://www.sota2.com/research/dataset/u2-bench>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 1. This is an index page, not the full collection.

- [Interactive Tool-Use Agent Performance on tau2-Bench (Retail, Airline, Telecom)](<https://www.sota2.com/research/sota/interactive-tool-use-agent-performance-on-tau2-bench-retail-airline-telecom.md>): Interactive Tool-Use Agent Performance; tau2-Bench.

- [Agentic Tool Use on Tau2-Bench (Domain Scores)](<https://www.sota2.com/research/sota/agentic-tool-use-on-tau2-bench-domain-scores.md>): Agentic tool-use; Tau2-Bench.

- [Agentic Tool-use on tau2-bench Airline](<https://www.sota2.com/research/sota/agentic-tool-use-on-tau2-bench-airline.md>): Agentic Tool-use; tau2-bench Airline.

- [Agentic Tool-use on tau2-bench Retail](<https://www.sota2.com/research/sota/agentic-tool-use-on-tau2-bench-retail.md>): Agentic Tool-use; tau2-bench Retail.

- [Agentic Performance on TAU2-Bench](<https://www.sota2.com/research/sota/agentic-performance-on-tau2-bench.md>): Agentic Performance; TAU2-Bench.

- [Tool Use Accuracy on tau2-Bench](<https://www.sota2.com/research/sota/tool-use-accuracy-on-tau2-bench.md>): Tool; tau2-Bench.

- [Multi-turn Decision Making on tau2-Bench held-out (test)](<https://www.sota2.com/research/sota/multi-turn-decision-making-on-tau2-bench-held-out-test.md>): Multi-turn Decision Making; tau2-Bench held-out (test).

- [Ultrasound Question Answering on U2-Bench disease-diagnosis](<https://www.sota2.com/research/sota/ultrasound-question-answering-on-u2-bench-disease-diagnosis.md>): Ultrasound Question Answering; U2-Bench disease-diagnosis.

- [Task failure prediction and selective task completion on tau2-bench Telecom 1.0](<https://www.sota2.com/research/sota/task-failure-prediction-and-selective-task-completion-on-tau2-bench-telecom-1-0.md>): Task failure prediction and selective task completion; tau2-bench Telecom 1.0.

- [Task failure prediction and selective task completion on tau2-bench Retail 1.0](<https://www.sota2.com/research/sota/task-failure-prediction-and-selective-task-completion-on-tau2-bench-retail-1-0.md>): Task failure prediction and selective task completion; tau2-bench Retail 1.0.

- [Task Failure Prediction and Selective Completion on tau2-bench Airline 1.0](<https://www.sota2.com/research/sota/task-failure-prediction-and-selective-completion-on-tau2-bench-airline-1-0.md>): Task failure prediction and selective task completion; tau2-bench Airline 1.0.

- [Stateful Interaction on tau2-bench](<https://www.sota2.com/research/sota/stateful-interaction-on-tau2-bench.md>): Stateful Interaction; tau2-bench.

- [Long-Horizon Tool Execution on tau2-Bench](<https://www.sota2.com/research/sota/long-horizon-tool-execution-on-tau2-bench.md>): Long-Horizon Tool Execution; tau2-Bench.

- [Real-world issue resolution on tau2-bench](<https://www.sota2.com/research/sota/real-world-issue-resolution-on-tau2-bench.md>): Real-world issue resolution; tau2-bench.

- [Agent Task Completion Average on tau2-bench, SkillsBench, and ALFWorld](<https://www.sota2.com/research/sota/agent-task-completion-average-on-tau2-bench-skillsbench-and-alfworld.md>): Agent Task Completion; tau2-bench, SkillsBench, and ALFWorld Average.

- [Agent Task Completion on tau2-bench telecom](<https://www.sota2.com/research/sota/agent-task-completion-on-tau2-bench-telecom.md>): Agent Task Completion; tau2-bench telecom.

- [Agent Task Completion on tau2-bench airline](<https://www.sota2.com/research/sota/agent-task-completion-on-tau2-bench-airline.md>): Agent Task Completion; tau2-bench airline.

- [Agent Task Success on tau2-bench Retail Domain](<https://www.sota2.com/research/sota/agent-task-success-on-tau2-bench-retail-domain.md>): Agent Task Success; tau2-bench Retail Domain.

- [Agent Skill Acquisition on tau2-bench](<https://www.sota2.com/research/sota/agent-skill-acquisition-on-tau2-bench.md>): Agentic Skill Acquisition; tau2-bench.

- [Tool-use Task Completion on Tau2-Bench Telecom subset Solo mode](<https://www.sota2.com/research/sota/tool-use-task-completion-on-tau2-bench-telecom-subset-solo-mode.md>): Tool-use Task Completion; Tau2-Bench Telecom subset Solo mode.

- [Agentic Function on Tau2-Bench](<https://www.sota2.com/research/sota/agentic-function-on-tau2-bench.md>): Agentic Function; Tau2-Bench.

- [Multi-turn agent decision making on tau2-Bench (test)](<https://www.sota2.com/research/sota/multi-turn-agent-decision-making-on-tau2-bench-test.md>): Multi-turn agent decision making; tau2-Bench (test).

- [False Success Detection on tau2-bench v1 v2 (test)](<https://www.sota2.com/research/sota/false-success-detection-on-tau2-bench-v1-v2-test.md>): False Success Detection; tau2-bench v1 v2 (test).

- [General Task (Agentic Coding) on tau2-Bench Telecom](<https://www.sota2.com/research/sota/general-task-agentic-coding-on-tau2-bench-telecom.md>): General Task (Agentic Coding); tau2-Bench Telecom.

- [Tool Use on Tau2-Bench](<https://www.sota2.com/research/sota/tool-use-on-tau2-bench.md>): Tool Use; Tau2-Bench.

- [User Simulation Behavioral Alignment on tau2-bench Retail + Airline (test)](<https://www.sota2.com/research/sota/user-simulation-behavioral-alignment-on-tau2-bench-retail-plus-airline-test.md>): User Simulation Behavioral Alignment; tau2-bench Retail + Airline (test).

- [User Simulation Behavioral Alignment on tau2-Bench Airline (test)](<https://www.sota2.com/research/sota/user-simulation-behavioral-alignment-on-tau2-bench-airline-test.md>): User Simulation Behavioral Alignment; tau2-bench Airline (test).

- [Failure prediction on tau2-bench Transfer held-out](<https://www.sota2.com/research/sota/failure-prediction-on-tau2-bench-transfer-held-out.md>): Failure prediction; tau2-bench Transfer held-out.

- [Failure prediction on tau2-bench Within corpus](<https://www.sota2.com/research/sota/failure-prediction-on-tau2-bench-within-corpus.md>): Failure prediction; tau2-bench Within corpus.

- [Tool Use on tau2-bench (productivity, proactivity, personalization)](<https://www.sota2.com/research/sota/tool-use-on-tau2-bench-productivity-proactivity-personalization.md>): Tool Use; tau2-bench.

- [Stateful service dialogue on tau2-bench Telecom](<https://www.sota2.com/research/sota/stateful-service-dialogue-on-tau2-bench-telecom.md>): Stateful service dialogue; tau2-bench Telecom.

- [Leave-one-corpus-out transfer on tau2-bench](<https://www.sota2.com/research/sota/leave-one-corpus-out-transfer-on-tau2-bench.md>): Leave-one-corpus-out transfer; tau2-bench.

- [Tool Use on tau2-Bench retail](<https://www.sota2.com/research/sota/tool-use-on-tau2-bench-retail.md>): Tool Use; tau2-Bench retail.

- [Tool-use Agent Scalability and Performance on Tau2-Bench](<https://www.sota2.com/research/sota/tool-use-agent-scalability-and-performance-on-tau2-bench.md>): Tool-use agent scalability and performance; Tau2-Bench.

- [Agentic Tool Use on tau2-Bench](<https://www.sota2.com/research/sota/agentic-tool-use-on-tau2-bench.md>): Agentic Tool Use; tau2-Bench.

- [False Success Detection on tau2-bench task-disjoint](<https://www.sota2.com/research/sota/false-success-detection-on-tau2-bench-task-disjoint.md>): False Success Detection; tau2-bench task-disjoint.

- [Agent Task Success on tau2-bench Airline Domain](<https://www.sota2.com/research/sota/agent-task-success-on-tau2-bench-airline-domain.md>): Agent Task Success; tau2-bench Airline Domain.
