Information Retrieval on JobSearch-XS (gold labels)
78.5NDCG@5JobMatchAI (Hybrid + Reranker)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| JobMatchAI (Hybrid + Reranker)BM25=✓, Sem.=✓, KG=✓+R, P50 (ms)=822026.03 | 78.5 | 81 | 29 | 35 | |
| KG-onlyBM25=✗, Sem.=✗, KG=✓2026.03 | 75.8 | 79 | 100 | 100 | |
| JobMatchAI (Hybrid)BM25=✓, Sem.=✓, KG=✓, P50 (ms)=822026.03 | 75 | 78 | 29 | 35 | |
| BM25 + KGBM25=✓, Sem.=✗, KG=✓, P50 (ms)=812026.03 | 74.7 | 77.6 | 33 | 39 | |
| BM25 + SemanticBM25=✓, Sem.=✓, KG=✗, P50 (ms)=802026.03 | 74 | 77.1 | 36 | 42 | |
| BM25BM25=✓, Sem.=✗, KG=✗, P50 (ms)=792026.03 | 72.1 | 75.6 | 49 | 57 |