Information Retrieval on ArguAna (nDCG@10, Latency, Speedup)
36.45nDCG@10AgentIR
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| AgentIRThreads=8, SIMD=true, Hardware=8-core Jetstream2 g3.medium2026.05 | 36.45 | 0.24 | 12 | |
| AgentIRHardware=NVIDIA A100-SXM4-40GB2026.05 | 36.45 | — | 17 | |
| Pyserini LuceneThreads=8, Hardware=8-core Jetstream2 g3.medium2026.05 | 35.68 | 2.81 | — |