held-out
Benchmarks
TaskDatasetSOTA resultTrendResults
Held-out (test)
0.932Median AUROC
66
Held-out
43.6BRR
40
Held-out (test)
6.84Average Block Efficiency
24
held-out N=50 randomized configurations (test)
0.122Hand RMS Jerk
22
held-out N=50 randomized configurations (test)
2.94Hand RMS Jerk
22
held-out N=50 randomized configurations (test)
4.086Hand RMS Jerk
22
held-out N=50 randomized configurations (test)
8.725Hand RMS Jerk
22
Held-Out (test)
0.766Reward
16
Held-out 12,282 examples (test)
89.39Accuracy
15
Held-out n = 560 (20% stratified test)
89.1Detection Rate
11
Held-out (test)
2.132RMS Jerk
11
Held-out n=300 (test)
0.747Pearson Correlation Coefficient
8
Held-out 2024 n=5185 (held-out)
0.136Brier Score
7
Held-out (test)
0Mean Error (mm)
7
Held-out 153 subjects (test)
92.2Rank-1 Retrieval
6
Held-out 153 subjects (test)
77.8R@1
6
Held-out 153 subjects (test)
0.07MAE
6
Held-out (test)
40.59PSNR
6
Held-out (test)
18.98BLEU-4
6
Held-out (test)
0.02MAE
5
Held-out (test)
100Coverage
5
Held-out
1,187ELO Score
5
held-out (test)
92.3Plate Accuracy
5
Held-out 2021-2023 (test)
35.6Non-neutral F1
4
held-out (test)
98.4Accuracy
4