FashionIQ
Benchmarks
TaskDatasetSOTA resultTrendResults
FashionIQ (val)
58.16Average Recall@10
653
FashionIQ Shirt
61.91Recall@10
92
FashionIQ (Dress)
52.91Recall@10
67
FashionIQ 1.0 (val)
43.49Average Recall@10
42
FashionIQ Toptee
50.48Recall@10
41
FashionIQ
57.2Recall@10
39
FashionIQ Tops&Tees
63.27R@10
26
FashionIQ (val)
41.07Recall@10 (Shirt)
23
FashionIQ 1.0 (test)
45.7R@10
20
FashionIQ Average
45.5mAP@5
14
FashionIQ Zero-Shot
3,681Average R@10
13
FashionIQ Tops&Tees (test)
64.67R@10
12
FashionIQ Shirts (test)
59.81Recall@10
12
FashionIQ Dresses (test)
53.13Recall@10
12
FashionIQ Dress, Shirt, Toptee
33.65Dress Recall@10
12
Multi-round FashionIQ (unseen)
61.2Recall@5
9
FashionIQ Multi-round
63.9R@5
9
FashionIQ
37.6Recall@10 (T0)
6
Multi-Turn FashionIQ (test)
48.3Recall@5 (Dresses)
6
Multi-Target FashionIQ (val)
42.45mAP@5 (Shirt)
4