Information Retrieval on SciFact (nDCG@10, Latency, Speedup)
0.6828nDCG@10AgentIR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AgentIRThreads=8, SIMD=true, Hardware=8-core Jetstream2 g3.medium2026.05 | 0.6828 | 0.08 | 18 | |
| AgentIRHardware=NVIDIA A100-SXM4-40GB2026.05 | 0.6828 | — | 37 | |
| Pyserini LuceneThreads=8, Hardware=8-core Jetstream2 g3.medium2026.05 | 0.6826 | 1.48 | — |