Information Retrieval on FiQA (nDCG@10, Latency, Speedup)
25.36nDCG@10Pyserini Lucene
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Pyserini LuceneThreads=8, Hardware=8-core Jetstream2 g3.medium2026.05 | 25.36 | 1.68 | — | |
| AgentIRThreads=8, SIMD=true, Hardware=8-core Jetstream2 g3.medium2026.05 | 24.25 | 0.15 | 11 | |
| AgentIRHardware=NVIDIA A100-SXM4-40GB2026.05 | 24.25 | — | 8 |