Retrieval on SciDocs
0.25h2d latency (ms)AgentIR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| AgentIRHardware=A100 40 GB, Batch size=all judged queries, chunked when B · N · 4B > 16 GB, k=100, |D|=25.7K, |Q|=1,0002026.05 | 0.25 | 0.62 | 98.3 | 0.12 | 0.11 | 19 | 100 |
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| AgentIRHardware=A100 40 GB, Batch size=all judged queries, chunked when B · N · 4B > 16 GB, k=100, |D|=25.7K, |Q|=1,0002026.05 | 0.25 | 0.62 | 98.3 | 0.12 | 0.11 | 19 | 100 |