Information Retrieval on Smart Home Knowledge Base 100 queries (test)
34.2Median Latency (ms)S5-HES Keyword
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| S5-HES KeywordRetrieval Strategy=Keyword2026.03 | 34.2 | 34.9 | 48.8 | |
| BM25Retrieval Strategy=Lexical2026.03 | 42.9 | 43.9 | 54.3 | |
| GTEModel Version=base2026.03 | 107.5 | 107.4 | 122 | |
| E5Model Version=base2026.03 | 120.4 | 137.1 | 141.7 | |
| S5-HES SemanticRetrieval Strategy=Semantic2026.03 | 136.3 | 136.8 | 153.5 | |
| BGEModel Version=base2026.03 | 177.7 | 199.2 | 196.2 | |
| S5-HES HybridRetrieval Strategy=Hybrid2026.03 | 204.4 | 313.3 | 225.1 |