Information Retrieval on Average Retrieval Evaluation (test)
66.1NDCG@5Llama Nemo 3B (multi)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Llama Nemo 3B (multi)Reranking k=10, Latency=6027.0782025.10 | 66.1 | 61.8 | |
| Llama Nemo 3B (multi)Reranking k=20, Latency=9470.1342025.10 | 65.77 | 61.02 | |
| Llama Nemo 3B (multi)Reranking k=GQR, Latency=2674.832025.10 | 65.15 | 60.1 | |
| Colnomic-7B (multi)Reranking k=20, Latency=7035.9532025.10 | 65.07 | 60.27 | |
| Llama Nemo 3B (multi)Reranking k=5, Latency=4332.552025.10 | 64.72 | 59.75 | |
| Colnomic-7B (multi)Reranking k=10, Latency=3586.8092025.10 | 64.37 | 59.92 | |
| Jina (vision, multi)Reranking k=20, Latency=7251.812025.10 | 64.1 | 59.6 | |
| Jina (vision, multi)Reranking k=10, Latency=3585.9462025.10 | 63.27 | 58.8 | |
| Llama Nemo 3B (multi)Reranking k=No-reranking, Latency=2591.142025.10 | 62.97 | 59.75 | |
| Colnomic-7B (multi)Reranking k=GQR, Latency=181.212025.10 | 62.75 | 58 | |
| Colnomic-7B (multi)Reranking k=5, Latency=1823.032025.10 | 62.12 | 57.32 | |
| Jina (vision, multi)Reranking k=GQR, Latency=213.972025.10 | 61 | 57.6 | |
| Jina (vision, multi)Reranking k=5, Latency=1860.7142025.10 | 60.7 | 56.17 | |
| Colnomic-7B (multi)Reranking k=No-reranking, Latency=115.982025.10 | 60.25 | 57.32 | |
| Jina (vision, multi)Reranking k=No-reranking, Latency=153.452025.10 | 57.2 | 56.17 |