Retrieval on FiQA (Latency and Speedup)
0.35H2D Latency (ms)AgentIR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| AgentIRHardware=A100 40 GB, Batch size=all judged queries, chunked when B · N · 4B > 16 GB, k=100, |D|=57.6K, |Q|=6482026.05 | 0.35 | 0.75 | 127.8 | 0.09 | 0.21 | 8 | 100 |