Retrieval on SciFact (Latency and Performance)
0.12H2D Latency (ms)AgentIR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| AgentIRHardware=A100 40 GB, Batch size=all judged queries, chunked when B · N · 4B > 16 GB, k=100, |D|=5.2K, |Q|=3002026.05 | 0.12 | 0.05 | 8.2 | 0.05 | 0.04 | 37 | 100 |