Agentic execution trace analysis on TraceBench Function Calling Tau2Bench
77Overall ScoreTraceSIR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| TraceSIRBackbone=Claude-4.62026.02 | 77 | 7.5 | 7.5 | 8.5 | 7.5 | 7.5 | 1 | |
| ClaudeCodeBackbone=Claude-4.62026.02 | 74 | 7.5 | 7.5 | 8.5 | 6.5 | 7 | 2 | |
| TraceSIRBackbone=GLM-52026.02 | 53 | 6 | 6 | 5 | 5 | 4.5 | 3 | |
| ClaudeCodeBackbone=GLM-52026.02 | 40 | 5 | 3.5 | 4.5 | 3 | 4 | 4 |