Tau-bench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
tau-Bench (test)
55.8Success Rate
7
tau-Bench
85.4Pass@1
6
tau-bench Airline (test)
0.944Mean Spearman Rho
5
Tau-bench retail
46Success Rate
5
Tau-bench airline
50Success Rate
5
tau-bench Transfer held-out
57.4ROC-AUC
4
tau-bench Within corpus
63.3ROC-AUC
4
tau-bench Retail and Airline
78.3Retail Success Rate
4
tau-bench Airline
58Task Completion Score (TCS)
4
tau-Bench retail (test)
7.8TPR
4
tau2-bench
72.5AUC
3
tau-bench
0.567AUC
3
Tau-bench OOD
41.4Average Score
3
Tau-bench OOD transfer
41.4Average Score
3
tau-Bench Retail
56Accuracy
3