Industrial Semantic Product Retrieval on Phoenix Contact Industrial Product Dataset (Expert)
94.3Hit Rate@5basicrr
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| basicrrLatency (s)=11.45, Ext. Costs ($)=0.002026.04 | 94.3 | 3.43 | 87.4 | 80.7 | 76 | |
| Claude Sonnet 4.6Latency (s)=49.41, Ext. Costs ($)=0.292026.04 | 91.4 | 3.51 | 90 | 31.1 | 73.1 | |
| advanced_bm25rrLatency (s)=13.06, Ext. Costs ($)=0.002026.04 | 85.7 | 2.69 | 73.7 | 59 | 59.3 | |
| GPT-4.1Latency (s)=16.42, Ext. Costs ($)=0.042026.04 | 82.9 | 2.17 | 76.9 | 16.7 | 43.7 | |
| GPT-5.2Latency (s)=45.51, Ext. Costs ($)=0.492026.04 | 71.4 | 2.43 | 71.4 | 17.9 | 49.2 | |
| advanced_bm25Latency (s)=0.30, Ext. Costs ($)=0.002026.04 | 31.4 | 0.86 | 24.2 | 59 | 26.1 |