Sister Tasks on extended tau-Bench Retail domain
83Pass@1 RatePolicyBank
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PolicyBankModel=Gemini-3-Pro2026.04 | 83 | 72 | 68 | 55 | |
| PolicyBankModel=Claude-4.5-Opus2026.04 | 78 | 69 | 67 | 67 | |
| ReasoningBankModel=Gemini-3-Pro2026.04 | 64 | 39 | 33 | 24 | |
| No memoryModel=Claude-4.5-Opus2026.04 | 47 | 29 | 25 | 22 | |
| ReasoningBankModel=Claude-4.5-Opus2026.04 | 45 | 36 | 30 | 28 | |
| AWMModel=Gemini-3-Pro2026.04 | 39 | 22 | 15 | 11 | |
| SynapseModel=Gemini-3-Pro2026.04 | 36 | 20 | 16 | 11 | |
| No memoryModel=Gemini-3-Pro2026.04 | 31 | 14 | 6 | 0 | |
| AWMModel=Claude-4.5-Opus2026.04 | 30 | 22 | 16 | 10 | |
| SynapseModel=Claude-4.5-Opus2026.04 | 27 | 18 | 16 | 14 |