Property-based retrieval on Short Stories (test)
49.9MAPCombined
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CombinedLLM reranking=true, n_phrases=18, T=0.22025.12 | 49.9 | 96.2 | |
| CombinedLLM reranking=false, n_phrases=18, T=0.22025.12 | 49.6 | 89 | |
| SAELLM reranking=true, n_phrases=18, T=0.22025.12 | 47.1 | 95 | |
| SAELLM reranking=false, n_phrases=18, T=0.22025.12 | 46.8 | 85.6 | |
| OpenAI+LLMLLM reranking=true, n_phrases=18, T=0.22025.12 | 41.1 | 90.6 | |
| OpenAI+LLMLLM reranking=false, n_phrases=18, T=0.22025.12 | 40.6 | 75 |