InfoSeek
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Infoseek M2KR setup (test)
42.8VQA Accuracy
8
InfoSeek
34.6Accuracy
8
InfoSeek
48.9Recall@5
8
InfoSeek M-BEIR (test)
59.1Recall@5
8
Infoseek M2KR
50.5Accuracy
7
InfoSeek (val)
86.4Recall@20
6
INFOSEEK Overall
62.7Top-1 Accuracy
6
InfoSeek-8
52.38Recall@5
6
InfoSeek 6
42.08R@5
6
Infoseek human (Unseen Question)
33.6Accuracy
6
Infoseek human (Unseen Entity)
31.4Accuracy
6
InfoSeek
62.7Recall@1
5
INFOSEEK (Overall)
33.2Accuracy
5
Infoseek (test)
78.3P@5
5
InfoSeek 25-sample perturbed subset
52Rotation
4
InfoSeek (val)
58.4Recall@1
3
InfoSeek Human
58.2Accuracy
3
INFOSEEK (Seen)
69.6Top-1 Accuracy
3
INFOSEEK (Unseen)
60.3Top-1 Accuracy
3
InfoSeek
20.6Omega
1