ViDoRe
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ViDoRe AI Targeted Setting III V1
93ASR-G Sim^-1 (Mean)
10
ViDoRe AI (Targeted Setting III) V1
100ASR-R@1 (Mean)
10
ViDoRe v2
0.592NDCG@5
10
Vidore V1 & V2
84.87Avg. Acc
10
ViDoRe 2
62.3Average NDCG@5
9
ViDoRe 2
58.6Recall@5 (Avg)
9
ViDoRe ESG V2
100ASR-G Sim (mean) @-1
9
ViDoRe ESG V2
48Recall@1
9
ViDoRe ESG v2 (test)
100ASR @1
9
ViDoRe v2
58.2Economics nDCG@5
7
ViDoRe-Econ union scope
57.2NDCG@5
7
ViDoRe-Bio union scope
0.575NDCG@5
7
ViDoRe
87.4ArxQ Score
6
ViDoRe-in-MIEB
85.64Retrieval Score
6
ViDoRe Industrial Dataset English-only V3 (test)
58.1NDCG@10
6
ViDoRe 3
2.89Avg NDCG@5 Gain (%)
5
ViDoRe v1 (test)
90.71Average Recall@5
4
ViDoRe Phar. V3
71.6Accuracy
3
ViDoRe Ind. V3
60.4Accuracy
3
ViDoRe H.R. V3
66.8Accuracy
3
ViDoRe Fin V3
58.4Accuracy
3
ViDoRe C.S. V3
84.4Accuracy
3