Retrieval on ArguAna (Latency and Accuracy)
6.72H2D Latency (ms)AgentIR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| AgentIRHardware=A100 40 GB, Batch size=all judged queries, chunked when B · N · 4B > 16 GB, k=100, |D|=8.7K, |Q|=1,4062026.05 | 6.72 | 2.51 | 49.11 | 0.15 | 0.17 | 17 | 100 |