STARK
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
STARK MAG official (test)
44.36Hit@1
8
STARK Amazon official (test)
49.87Hit@1
8
STaRK-Prime multi-hop (test)
34.1Hits@1
6
STaRK-Prime (test)
29.7Hits@1
6
STARK-PRIME (test)
42.72MRR
6
STARK-PRIME (test)
41.75MRR
6
STARK-PRIME 1.0 (leave-out set of human-generated queries)
33.03Hit@1
6
STARK-MAG 1.0 (leave-out set of human-generated queries)
33.33Hit@1
6
STARK-AMAZON 1.0 (leave-out set of human-generated queries)
58.32Hit@1
6