StableToolBench
Benchmarks
TaskDatasetSOTA resultTrendResults
StableToolBench
72.8I2 Category Success
28
StableToolBench (STB)
49.25EM Accuracy
16
StableToolBench cost-augmented
76PR
14
StableToolBench Held-In
50.4Pass Rate
14
StableToolBench Average
70.3SoPR
13
StableToolBench I3-Inst.
76SoPR
13
StableToolBench I2-Cat.
71.9SoPR
13
StableToolBench I2-Inst.
73.4SoPR
13
StableToolBench I1-Cat.
70.9SoPR
13
StableToolBench I1-Tool
73.9SoPR
13
StableToolBench I1-Inst.
69SoPR
13
StableToolBench G1 Category
76.8SL
12
StableToolBench 1.0 (test)
50.3I1 Instruction Success Rate
10
StableToolBench
16.47ID High Success Rate
8
StableToolBench Overall Average
70.3SL (Success Rate)
6
StableToolBench G3 Instruction
66.3SL Score
6
StableToolBench G2 Instruction
68.8SL Score
6
StableToolBench G2 Category
71SL
6
StableToolBench G1 Instruction
75.5SL Score
6
StableToolBench (STB) I3-Inst
48.3Solvable Pass Rate
6
StableToolBench v1 (test)
75.5G1 Category SL
5
StableToolBench trace-free (test)
6.8F1 Score (Impr Pts)
4