Tau-bench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Tau2-Bench
90.4Retail Score
59
tau-bench
78.3Retail Accuracy
55
tau-bench multi-burst-augmented cache
68Hit@2
52
tau-bench Retail
64.8Pass@1
38
tau-bench
86.1Retail Success Rate
35
tau-bench Airline
78Pass@4
29
tau-Bench Airline
39.1Pass@1
22
TAU2-Bench
85.4Success Rate
20
tau2-Bench
80.3Accuracy
17
τ2-Bench (Tau-bench) Retail and Telecom
85.79Overall Success Rate
17
Tau-Bench
67.5TAU-AIR Score
14
Tau-Bench
71.3Retail Score
13
Tau-bench Retail (test)
66Pass Rate
12
Tau-Bench Airline v2 (test)
70Pass Rate
11
Tau-bench Telecom
45.39Avg@4 Score
10
Tau-bench Retail
60.31Avg@4
10
extended tau-Bench Retail domain
90Pass@1
10
extended tau-Bench Retail domain
83Pass@1 Rate
10
tau-Bench Airline domain extended
70Pass Rate @ Threshold 1
10
extended tau-Bench Airline domain
74Pass@1 Rate
10
tau-bench retail domain
57Accuracy
10
tau-bench airline domain
43.2Tool Use Accuracy (Airline)
10
Tau-bench (τ²)
88.74Average Accuracy
8
tau-Bench (test)
59Execution Accuracy
8
Tau2-Bench
81.2Score
7