Recommendation Retrieval on 80M production dataset
1,210Throughput (QPS)SilverTorch
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SilverTorchNumber of GPUs=22025.11 | 1,210 | 33.27 | 0.0077 | 20.9 | |
| SilverTorch-OverArchOverArch scoring layer=true, In-model Value Model=true2025.11 | 771 | 33.27 | 0.012 | 13.35 | |
| Baseline-GPUFaiss shards=2, Forward index shards=62025.11 | 340 | 33.27 | 0.0272 | 5.8 | |
| Baseline-GPUFaiss shards=2, Forward index shards=42025.11 | 186 | 30.29 | 0.0452 | 3.48 | |
| Baseline-CPUPlatform=CPU2025.11 | 51 | 28.92 | 0.158 | 1 |