benchmark suite
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
10-benchmark suite average
73.81Average Accuracy
15
Full Benchmark Suite Aggregate
82.2Average Accuracy
10
Full Benchmark Suite Gravity and Morph shifts
820.8Total Score
7
Benchmark Suite Aggregate
65.1Average Score
6
36-circuit benchmark suite Combined
19,507.5Geometric-mean Execution Time
4
20-domain benchmark suite
58.05h-mean
4
benchmark suite 20-task
2,520Average End-to-End Latency (ms)
3
Full benchmark suite Very Large
6TP
3
Full Benchmark Suite
75.15S_tot Retention
2