Information Retrieval on HC corpus 6.04M docs, 237K queries, 8 languages (test)
55.7Recall@1Neural Sparse
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Neural SparseHardware=p4d.24xlarge, Concurrency=322026.05 | 55.7 | 91.4 | 2,471 | |
| Fuzzy Edit-DistanceHardware=p4d.24xlarge, Concurrency=322026.05 | 50.8 | 83.4 | 1,465 | |
| HCI Trigram (prod.)Hardware=p4d.24xlarge, Concurrency=322026.05 | 47.5 | 57.7 | 2,299 | |
| Vanilla TrigramHardware=p4d.24xlarge, Concurrency=322026.05 | 31.6 | 52.1 | 2,634 |