SPAR-Bench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SPAR-Bench
67.3Overall Score
59
SPAR-Bench
61.9Accuracy (Avg)
57
SPAR-Bench
67.3Accuracy
31
SPAR-Bench full
68.35Average Score
23
SPAR-Bench SI
54.3Low Score
15
SPAR-Bench-MV (test)
43.7Score (Low Difficulty)
15
SPAR-Bench 2025
68.1Accuracy
12
SPAR-Bench tiny
72.32Medium Difficulty Score
12
SPAR-Bench SI, MV 91
63.3Accuracy
11
SPAR-Bench high-level tasks
51.28High Average Score
8