Information Retrieval on ACORDAR pilot collection 2.0
51.44MAPOriginal metadata
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Original metadataRetrieval Backend=Dense2026.07 | 51.44 | 56.28 | 78.33 | 39.9 | |
| Metadata RewriteRetrieval Backend=Dense2026.07 | 51.31 | 57.66 | 76.8 | 40.04 | |
| Profile RewriteRetrieval Backend=Dense2026.07 | 50.31 | 56.52 | 72.7 | 40.28 | |
| Metadata RewriteRetrieval Backend=BM252026.07 | 45.62 | 47.82 | 79.51 | 32.2 | |
| Dataset Agent + titleRetrieval Backend=Dense2026.07 | 45.51 | 49.82 | 76.46 | 38.38 | |
| Original metadataRetrieval Backend=BM252026.07 | 45.2 | 44.87 | 68.67 | 33.38 | |
| Profile RewriteRetrieval Backend=BM252026.07 | 44.82 | 46.44 | 74.89 | 33.3 | |
| Profile Gen + titleRetrieval Backend=Dense2026.07 | 42.51 | 48.78 | 82.07 | 35.82 | |
| Profile Gen + titleRetrieval Backend=BM252026.07 | 38.09 | 43.24 | 72.79 | 31.57 | |
| Dataset AgentRetrieval Backend=Dense2026.07 | 36.78 | 41.8 | 77.21 | 30.61 | |
| Dataset Agent + titleRetrieval Backend=BM252026.07 | 34.71 | 41.05 | 70.6 | 27.61 | |
| Profile GenRetrieval Backend=Dense2026.07 | 30.38 | 37.4 | 63.14 | 28.58 | |
| Dataset AgentRetrieval Backend=BM252026.07 | 28.02 | 34.94 | 61.53 | 25.13 | |
| Profile GenRetrieval Backend=BM252026.07 | 25.55 | 33.56 | 62.73 | 24.13 |