STARK
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
STaRK-Amazon 1.0 (Human)
61.73Hits@1
32
STARK Amazon
70.7H@1
25
STARK PRIME
68.9H@1
25
STARK
79.3EM
24
STaRK-Prime Synthetic 1.0
0.464Hits@1
20
STaRK-MAG Synthetic 1.0
74.1Hits@1
20
STaRK-Amazon Synthetic 1.0
64Hits@1
20
STaRK MAG Synthetic
78.8Recall@20
20
STaRK-Prime 1.0 (test)
69.72Hit@1
18
STaRK-Prime 1.0 (Human)
0.45Hits@1
16
STaRK PRIME Human
66.37Recall@20
16
STaRK MAG Human
56.4Recall@20
16
STaRK AMAZON (Human)
42.43Recall@20
16
STaRK PRIME synthetic (test)
51.39Hit@1
13
STaRK MAG synthetic (test)
73.4Hit@1
13
STaRK synthetically generated
62Hit@1
12
STARK MAG
39.7Hits@1
11
STaRK AMAZON human-generated (test)
61.7Hit@1
10
STaRK MAG human-generated (test)
52.4Hit@1
10
STaRK PRIME human-generated (test)
57.1Hit@1
10
STARK AMAZON
0.319Hit@1
9
STARK MAG
24.4Hit Rate @ 1
9
STARK-PRIME
19.9Hit@1
9
STaRK human-generated
55.8Hit@1
9
STARK-PRIME official (test)
18.44Hit@1
8