PinchBench
Benchmarks
TaskDatasetSOTA resultTrendResults
PinchBench (PB)
100Accuracy
21
PINCHBENCH 23 tasks original
93.3Best Success Rate
19
PinchBench
88.7Pass@1
17
PinchBench
91.3Score
16
PINCHBENCH 123 tasks expanded
90.3Best Success Rate
15
PinchBench
82.3Average Score
15
PinchBench v2.0.0
89.6Utility Score
12
PinchBench Continuous Mode
81.3Overall Score
11
PinchBench Isolated Mode
81Overall Score
11
PinchBench
87.6Avg@3
6
PinchBench v2.0.0
89.31Best Score
6
PinchBench v1.2.0
90.1Best Score
6
PinchBench
83.7Accuracy
5