Property-based retrieval on The Pile (test)
54.2MAPCombined
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CombinedLLM reranking=true, n_phrases=18, T=0.22025.12 | 54.2 | 95.6 | |
| CombinedLLM reranking=false, n_phrases=18, T=0.22025.12 | 53 | 89.8 | |
| OpenAI+LLMLLM reranking=true, n_phrases=18, T=0.22025.12 | 46.4 | 92.4 | |
| SAELLM reranking=true, n_phrases=18, T=0.22025.12 | 45.6 | 93.4 | |
| OpenAI+LLMLLM reranking=false, n_phrases=18, T=0.22025.12 | 44.6 | 74 | |
| SAELLM reranking=false, n_phrases=18, T=0.22025.12 | 44.3 | 83.2 |